Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Czert -- Czech BERT-like Model for Language Representation   This paper describes the training process of the first Czech monolingual
language representation models based on BERT and ALBERT architectures. We
pre-train our models on more than 340K of sentences, which is 50 times more
than multilingual models that include Czech data. We outperform the
multilingual models on 9 out of 11 datasets. In addition, we establish the new
state-of-the-art results on nine datasets. At the end, we discuss properties of
monolingual and multilingual models based upon our results. We publish all the
pre-trained and fine-tuned models freely for the research community.

24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
27
The categories of this paper are: comp-gas
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th