Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Data Rejuvenation: Exploiting Inactive Training Examples for Neural
  Machine Translation   Large-scale training datasets lie at the core of the recent success of neural
machine translation (NMT) models. However, the complex patterns and potential
noises in the large-scale data make training NMT models difficult. In this
work, we explore to identify the inactive training examples which contribute
less to the model performance, and show that the existence of inactive examples
depends on the data distribution. We further introduce data rejuvenation to
improve the training of NMT models on large-scale datasets by exploiting
inactive examples. The proposed framework consists of three phases. First, we
train an identification model on the original training data, and use it to
distinguish inactive examples and active examples by their sentence-level
output probabilities. Then, we train a rejuvenation model on the active
examples, which is used to re-label the inactive examples with
forward-translation. Finally, the rejuvenated examples and the active examples
are combined to train the final NMT model. Experimental results on WMT14
English-German and English-French datasets show that the proposed data
rejuvenation consistently and significantly improves performance for several
strong NMT models. Extensive analyses reveal that our approach stabilizes and
accelerates the training process of NMT models, resulting in final models with
better generalization capability.

28
The categories of this paper are: alg-geom
3
The categories of this paper are: physics
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin