Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Chemical Identification and Indexing in PubMed Articles via BERT and
  Text-to-Text Approaches   The Biocreative VII Track-2 challenge consists of named entity recognition,
entity-linking (or entity-normalization), and topic indexing tasks -- with
entities and topics limited to chemicals for this challenge. Named entity
recognition is a well-established problem and we achieve our best performance
with BERT-based BioMegatron models. We extend our BERT-based approach to the
entity linking task. After the second stage of pretraining BioBERT with a
metric-learning loss strategy called self-alignment pretraining (SAP), we link
entities based on the cosine similarity between their SAP-BioBERT word
embeddings. Despite the success of our named entity recognition experiments, we
find the chemical indexing task generally more challenging.
  In addition to conventional NER methods, we attempt both named entity
recognition and entity linking with a novel text-to-text or "prompt" based
method that uses generative language models such as T5 and GPT. We achieve
encouraging results with this new approach.

34
The categories of this paper are: chem-ph
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
2
The categories of this paper are: math
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
35
The categories of this paper are: mtrl-th
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin