Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Neural Machine Translation with Word Predictions   In the encoder-decoder architecture for neural machine translation (NMT), the
hidden states of the recurrent structures in the encoder and decoder carry the
crucial information about the sentence.These vectors are generated by
parameters which are updated by back-propagation of translation errors through
time. We argue that propagating errors through the end-to-end recurrent
structures are not a direct way of control the hidden vectors. In this paper,
we propose to use word predictions as a mechanism for direct supervision. More
specifically, we require these vectors to be able to predict the vocabulary in
target sentence. Our simple mechanism ensures better representations in the
encoder and decoder without using any extra data or annotation. It is also
helpful in reducing the target side vocabulary and improving the decoding
efficiency. Experiments on Chinese-English and German-English machine
translation tasks show BLEU improvements by 4.53 and 1.3, respectively

29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
10
The categories of this paper are: q-bio