Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Non-Autoregressive Translation with Layer-Wise Prediction and Deep
  Supervision   How do we perform efficient inference while retaining high translation
quality? Existing neural machine translation models, such as Transformer,
achieve high performance, but they decode words one by one, which is
inefficient. Recent non-autoregressive translation models speed up the
inference, but their quality is still inferior. In this work, we propose DSLP,
a highly efficient and high-performance model for machine translation. The key
insight is to train a non-autoregressive Transformer with Deep Supervision and
feed additional Layer-wise Predictions. We conducted extensive experiments on
four translation tasks (both directions of WMT'14 EN-DE and WMT'16 EN-RO).
Results show that our approach consistently improves the BLEU scores compared
with respective base models. Specifically, our best variant outperforms the
autoregressive model on three translation tasks, while being 14.8 times more
efficient in inference.

25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
35
The categories of this paper are: mtrl-th
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
26
The categories of this paper are: bayes-an