Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Enhanced Language Representation with Label Knowledge for Span
  Extraction   Span extraction, aiming to extract text spans (such as words or phrases) from
plain texts, is a fundamental process in Information Extraction. Recent works
introduce the label knowledge to enhance the text representation by formalizing
the span extraction task into a question answering problem (QA Formalization),
which achieves state-of-the-art performance. However, QA Formalization does not
fully exploit the label knowledge and suffers from low efficiency in
training/inference. To address those problems, we introduce a new paradigm to
integrate label knowledge and further propose a novel model to explicitly and
efficiently integrate label knowledge into text representations. Specifically,
it encodes texts and label annotations independently and then integrates label
knowledge into text representation with an elaborate-designed semantics fusion
module. We conduct extensive experiments on three typical span extraction
tasks: flat NER, nested NER, and event detection. The empirical results show
that 1) our method achieves state-of-the-art performance on four benchmarks,
and 2) reduces training time and inference time by 76% and 77% on average,
respectively, compared with the QA Formalization paradigm. Our code and data
are available at https://github.com/Akeepers/LEAR.

30
The categories of this paper are: q-alg
20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
28
The categories of this paper are: alg-geom