Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Token-wise Curriculum Learning for Neural Machine Translation   Existing curriculum learning approaches to Neural Machine Translation (NMT)
require sampling sufficient amounts of "easy" samples from training data at the
early training stage. This is not always achievable for low-resource languages
where the amount of training data is limited. To address such limitation, we
propose a novel token-wise curriculum learning approach that creates sufficient
amounts of easy samples. Specifically, the model learns to predict a short
sub-sequence from the beginning part of each target sentence at the early stage
of training, and then the sub-sequence is gradually expanded as the training
progresses. Such a new curriculum design is inspired by the cumulative effect
of translation errors, which makes the latter tokens more difficult to predict
than the beginning ones. Extensive experiments show that our approach can
consistently outperform baselines on 5 language pairs, especially for
low-resource languages. Combining our approach with sentence-level methods
further improves the performance on high-resource languages.

16
The categories of this paper are: stat
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
8
The categories of this paper are: hep-ex
17
The categories of this paper are: q-fin