Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Efficiently Reusing Old Models Across Languages via Transfer Learning   Recent progress in neural machine translation is directed towards larger
neural networks trained on an increasing amount of hardware resources. As a
result, NMT models are costly to train, both financially, due to the
electricity and hardware cost, and environmentally, due to the carbon
footprint. It is especially true in transfer learning for its additional cost
of training the "parent" model before transferring knowledge and training the
desired "child" model. In this paper, we propose a simple method of re-using an
already trained model for different language pairs where there is no need for
modifications in model architecture. Our approach does not need a separate
parent model for each investigated language pair, as it is typical in NMT
transfer learning. To show the applicability of our method, we recycle a
Transformer model trained by different researchers and use it to seed models
for different language pairs. We achieve better translation quality and shorter
convergence times than when training from random initialization.

33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
26
The categories of this paper are: bayes-an
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph