Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: EntEval: A Holistic Evaluation Benchmark for Entity Representations   Rich entity representations are useful for a wide class of problems involving
entities. Despite their importance, there is no standardized benchmark that
evaluates the overall quality of entity representations. In this work, we
propose EntEval: a test suite of diverse tasks that require nontrivial
understanding of entities including entity typing, entity similarity, entity
relation prediction, and entity disambiguation. In addition, we develop
training techniques for learning better entity representations by using natural
hyperlink annotations in Wikipedia. We identify effective objectives for
incorporating the contextual information in hyperlinks into state-of-the-art
pretrained language models and show that they improve strong baselines on
multiple EntEval tasks.

4
The categories of this paper are: cond-mat
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
16
The categories of this paper are: stat
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
25
The categories of this paper are: patt-sol
35
The categories of this paper are: mtrl-th
30
The categories of this paper are: q-alg