Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MvSR-NAT: Multi-view Subset Regularization for Non-Autoregressive
  Machine Translation   Conditional masked language models (CMLM) have shown impressive progress in
non-autoregressive machine translation (NAT). They learn the conditional
translation model by predicting the random masked subset in the target
sentence. Based on the CMLM framework, we introduce Multi-view Subset
Regularization (MvSR), a novel regularization method to improve the performance
of the NAT model. Specifically, MvSR consists of two parts: (1) \textit{shared
mask consistency}: we forward the same target with different mask strategies,
and encourage the predictions of shared mask positions to be consistent with
each other. (2) \textit{model consistency}, we maintain an exponential moving
average of the model weights, and enforce the predictions to be consistent
between the average model and the online model. Without changing the CMLM-based
architecture, our approach achieves remarkable performance on three public
benchmarks with 0.36-1.14 BLEU gains over previous NAT models. Moreover,
compared with the stronger Transformer baseline, we reduce the gap to 0.01-0.44
BLEU scores on small datasets (WMT16 RO$\leftrightarrow$EN and IWSLT
DE$\rightarrow$EN).

8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con