Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Relation-Guided Pre-Training for Open-Domain Question Answering   Answering complex open-domain questions requires understanding the latent
relations between involving entities. However, we found that the existing QA
datasets are extremely imbalanced in some types of relations, which hurts the
generalization performance over questions with long-tail relations. To remedy
this problem, in this paper, we propose a Relation-Guided Pre-Training
(RGPT-QA) framework. We first generate a relational QA dataset covering a wide
range of relations from both the Wikidata triplets and Wikipedia hyperlinks. We
then pre-train a QA model to infer the latent relations from the question, and
then conduct extractive QA to get the target answer entity. We demonstrate that
by pretraining with propoed RGPT-QA techique, the popular open-domain QA model,
Dense Passage Retriever (DPR), achieves 2.2%, 2.4%, and 6.3% absolute
improvement in Exact Match accuracy on Natural Questions, TriviaQA, and
WebQuestions. Particularly, we show that RGPT-QA improves significantly on
questions with long-tail relations

36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat