Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Language Models are Open Knowledge Graphs   This paper shows how to construct knowledge graphs (KGs) from pre-trained
language models (e.g., BERT, GPT-2/3), without human supervision. Popular KGs
(e.g, Wikidata, NELL) are built in either a supervised or semi-supervised
manner, requiring humans to create knowledge. Recent deep language models
automatically acquire knowledge from large-scale corpora via pre-training. The
stored knowledge has enabled the language models to improve downstream NLP
tasks, e.g., answering questions, and writing code and articles. In this paper,
we propose an unsupervised method to cast the knowledge contained within
language models into KGs. We show that KGs are constructed with a single
forward pass of the pre-trained language models (without fine-tuning) over the
corpora. We demonstrate the quality of the constructed KGs by comparing to two
KGs (Wikidata, TAC KBP) created by humans. Our KGs also provide open factual
knowledge that is new in the existing KGs. Our code and KGs will be made
publicly available.

29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
24
The categories of this paper are: dg-ga
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
35
The categories of this paper are: mtrl-th