Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Crosslingual Embeddings are Essential in UNMT for Distant Languages: An
  English to IndoAryan Case Study   Recent advances in Unsupervised Neural Machine Translation (UNMT) have
minimized the gap between supervised and unsupervised machine translation
performance for closely related language pairs. However, the situation is very
different for distant language pairs. Lack of lexical overlap and low syntactic
similarities such as between English and Indo-Aryan languages leads to poor
translation quality in existing UNMT systems. In this paper, we show that
initializing the embedding layer of UNMT models with cross-lingual embeddings
shows significant improvements in BLEU score over existing approaches with
embeddings randomly initialized. Further, static embeddings (freezing the
embedding layer weights) lead to better gains compared to updating the
embedding layer weights during training (non-static). We experimented using
Masked Sequence to Sequence (MASS) and Denoising Autoencoder (DAE) UNMT
approaches for three distant language pairs. The proposed cross-lingual
embedding initialization yields BLEU score improvement of as much as ten times
over the baseline for English-Hindi, English-Bengali, and English-Gujarati. Our
analysis shows the importance of cross-lingual embedding, comparisons between
approaches, and the scope of improvements in these systems.

36
The categories of this paper are: cmp-lg
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
33
The categories of this paper are: plasm-ph
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
32
The categories of this paper are: atom-ph
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph