Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: AfroMT: Pretraining Strategies and Reproducible Benchmarks for
  Translation of 8 African Languages   Reproducible benchmarks are crucial in driving progress of machine
translation research. However, existing machine translation benchmarks have
been mostly limited to high-resource or well-represented languages. Despite an
increasing interest in low-resource machine translation, there are no
standardized reproducible benchmarks for many African languages, many of which
are used by millions of speakers but have less digitized textual data. To
tackle these challenges, we propose AfroMT, a standardized, clean, and
reproducible machine translation benchmark for eight widely spoken African
languages. We also develop a suite of analysis tools for system diagnosis
taking into account the unique properties of these languages. Furthermore, we
explore the newly considered case of low-resource focused pretraining and
develop two novel data augmentation-based strategies, leveraging word-level
alignment information and pseudo-monolingual data for pretraining multilingual
sequence-to-sequence models. We demonstrate significant improvements when
pretraining on 11 languages, with gains of up to 2 BLEU points over strong
baselines. We also show gains of up to 12 BLEU points over cross-lingual
transfer baselines in data-constrained scenarios. All code and pretrained
models will be released as further steps towards larger reproducible benchmarks
for African languages.

31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom
16
The categories of this paper are: stat
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
19
The categories of this paper are: eess
2
The categories of this paper are: math