Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: It's not Greek to mBERT: Inducing Word-Level Translations from
  Multilingual BERT   Recent works have demonstrated that multilingual BERT (mBERT) learns rich
cross-lingual representations, that allow for transfer across languages. We
study the word-level translation information embedded in mBERT and present two
simple methods that expose remarkable translation capabilities with no
fine-tuning. The results suggest that most of this information is encoded in a
non-linear way, while some of it can also be recovered with purely linear
tools. As part of our analysis, we test the hypothesis that mBERT learns
representations which contain both a language-encoding component and an
abstract, cross-lingual component, and explicitly identify an empirical
language-identity subspace within mBERT representations.

7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
19
The categories of this paper are: eess
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat