Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Beyond the English Web: Zero-Shot Cross-Lingual and Lightweight
  Monolingual Classification of Registers   We explore cross-lingual transfer of register classification for web
documents. Registers, that is, text varieties such as blogs or news are one of
the primary predictors of linguistic variation and thus affect the automatic
processing of language. We introduce two new register annotated corpora,
FreCORE and SweCORE, for French and Swedish. We demonstrate that deep
pre-trained language models perform strongly in these languages and outperform
previous state-of-the-art in English and Finnish. Specifically, we show 1) that
zero-shot cross-lingual transfer from the large English CORE corpus can match
or surpass previously published monolingual models, and 2) that lightweight
monolingual classification requiring very little training data can reach or
surpass our zero-shot performance. We further analyse classification results
finding that certain registers continue to pose challenges in particular for
cross-lingual transfer.

25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
13
The categories of this paper are: quant-ph
16
The categories of this paper are: stat
2
The categories of this paper are: math
27
The categories of this paper are: comp-gas
18
The categories of this paper are: econ
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys