Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Decoding-History-Based Adaptive Control of Attention for Neural Machine
  Translation   Attention-based sequence-to-sequence model has proved successful in Neural
Machine Translation (NMT). However, the attention without consideration of
decoding history, which includes the past information in the decoder and the
attention mechanism, often causes much repetition. To address this problem, we
propose the decoding-history-based Adaptive Control of Attention (ACA) for the
NMT model. ACA learns to control the attention by keeping track of the decoding
history and the current information with a memory vector, so that the model can
take the translated contents and the current information into consideration.
Experiments on Chinese-English translation and the English-Vietnamese
translation have demonstrated that our model significantly outperforms the
strong baselines. The analysis shows that our model is capable of generating
translation with less repetition and higher accuracy. The code will be
available at https://github.com/lancopku

8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
16
The categories of this paper are: stat
7
The categories of this paper are: hep-th
6
The categories of this paper are: astro-ph
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol