Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Knowledge Enhanced Pretrained Language Models: A Compreshensive Survey   Pretrained Language Models (PLM) have established a new paradigm through
learning informative contextualized representations on large-scale text corpus.
This new paradigm has revolutionized the entire field of natural language
processing, and set the new state-of-the-art performance for a wide variety of
NLP tasks. However, though PLMs could store certain knowledge/facts from
training corpus, their knowledge awareness is still far from satisfactory. To
address this issue, integrating knowledge into PLMs have recently become a very
active research area and a variety of approaches have been developed. In this
paper, we provide a comprehensive survey of the literature on this emerging and
fast-growing field - Knowledge Enhanced Pretrained Language Models (KE-PLMs).
We introduce three taxonomies to categorize existing work. Besides, we also
survey the various NLU and NLG applications on which KE-PLM has demonstrated
superior performance over vanilla PLMs. Finally, we discuss challenges that
face KE-PLMs and also promising directions for future research.

5
The categories of this paper are: gr-qc
25
The categories of this paper are: patt-sol
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
15
The categories of this paper are: nucl-ex
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio