Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Integrated Training for Sequence-to-Sequence Models Using
  Non-Autoregressive Transformer   Complex natural language applications such as speech translation or pivot
translation traditionally rely on cascaded models. However, cascaded models are
known to be prone to error propagation and model discrepancy problems.
Furthermore, there is no possibility of using end-to-end training data in
conventional cascaded systems, meaning that the training data most suited for
the task cannot be used. Previous studies suggested several approaches for
integrated end-to-end training to overcome those problems, however they mostly
rely on (synthetic or natural) three-way data. We propose a cascaded model
based on the non-autoregressive Transformer that enables end-to-end training
without the need for an explicit intermediate representation. This new
architecture (i) avoids unnecessary early decisions that can cause errors which
are then propagated throughout the cascaded models and (ii) utilizes the
end-to-end training data directly. We conduct an evaluation on two pivot-based
machine translation tasks, namely French-German and German-Czech. Our
experimental results show that the proposed architecture yields an improvement
of more than 2 BLEU for French-German over the cascaded baseline.

24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat