Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: AnchiBERT: A Pre-Trained Model for Ancient ChineseLanguage Understanding
  and Generation   Ancient Chinese is the essence of Chinese culture. There are several natural
language processing tasks of ancient Chinese domain, such as ancient-modern
Chinese translation, poem generation, and couplet generation. Previous studies
usually use the supervised models which deeply rely on parallel data. However,
it is difficult to obtain large-scale parallel data of ancient Chinese. In
order to make full use of the more easily available monolingual ancient Chinese
corpora, we release AnchiBERT, a pre-trained language model based on the
architecture of BERT, which is trained on large-scale ancient Chinese corpora.
We evaluate AnchiBERT on both language understanding and generation tasks,
including poem classification, ancient-modern Chinese translation, poem
generation, and couplet generation. The experimental results show that
AnchiBERT outperforms BERT as well as the non-pretrained models and achieves
state-of-the-art results in all cases.

10
The categories of this paper are: q-bio
4
The categories of this paper are: cond-mat
5
The categories of this paper are: gr-qc
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex
3
The categories of this paper are: physics
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int