Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Subword Mapping and Anchoring across Languages   State-of-the-art multilingual systems rely on shared vocabularies that
sufficiently cover all considered languages. To this end, a simple and
frequently used approach makes use of subword vocabularies constructed jointly
over several languages. We hypothesize that such vocabularies are suboptimal
due to false positives (identical subwords with different meanings across
languages) and false negatives (different subwords with similar meanings). To
address these issues, we propose Subword Mapping and Anchoring across Languages
(SMALA), a method to construct bilingual subword vocabularies. SMALA extracts
subword alignments using an unsupervised state-of-the-art mapping technique and
uses them to create cross-lingual anchors based on subword similarities. We
demonstrate the benefits of SMALA for cross-lingual natural language inference
(XNLI), where it improves zero-shot transfer to an unseen language without
task-specific data, but only by sharing subword embeddings. Moreover, in neural
machine translation, we show that joint subword vocabularies obtained with
SMALA lead to higher BLEU scores on sentences that contain many false positives
and false negatives.

0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
5
The categories of this paper are: gr-qc
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
19
The categories of this paper are: eess
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg