Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Are the Multilingual Models Better? Improving Czech Sentiment with
  Transformers   In this paper, we aim at improving Czech sentiment with transformer-based
models and their multilingual versions. More concretely, we study the task of
polarity detection for the Czech language on three sentiment polarity datasets.
We fine-tune and perform experiments with five multilingual and three
monolingual models. We compare the monolingual and multilingual models'
performance, including comparison with the older approach based on recurrent
neural networks. Furthermore, we test the multilingual models and their ability
to transfer knowledge from English to Czech (and vice versa) with zero-shot
cross-lingual classification. Our experiments show that the huge multilingual
models can overcome the performance of the monolingual models. They are also
able to detect polarity in another language without any training data, with
performance not worse than 4.4 % compared to state-of-the-art monolingual
trained models. Moreover, we achieved new state-of-the-art results on all three
datasets.

13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
5
The categories of this paper are: gr-qc
28
The categories of this paper are: alg-geom
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
30
The categories of this paper are: q-alg
2
The categories of this paper are: math
17
The categories of this paper are: q-fin
36
The categories of this paper are: cmp-lg
25
The categories of this paper are: patt-sol