Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Evaluating Pretrained Transformer Models for Entity Linking in
  Task-Oriented Dialog   The wide applicability of pretrained transformer models (PTMs) for natural
language tasks is well demonstrated, but their ability to comprehend short
phrases of text is less explored. To this end, we evaluate different PTMs from
the lens of unsupervised Entity Linking in task-oriented dialog across 5
characteristics -- syntactic, semantic, short-forms, numeric and phonetic. Our
results demonstrate that several of the PTMs produce sub-par results when
compared to traditional techniques, albeit competitive to other neural
baselines. We find that some of their shortcomings can be addressed by using
PTMs fine-tuned for text-similarity tasks, which illustrate an improved ability
in comprehending semantic and syntactic correspondences, as well as some
improvements for short-forms, numeric and phonetic variations in entity
mentions. We perform qualitative analysis to understand nuances in their
predictions and discuss scope for further improvements. Code can be found at
https://github.com/murali1996/el_tod

31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
12
The categories of this paper are: nucl-th
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
14
The categories of this paper are: math-ph
15
The categories of this paper are: nucl-ex
22
The categories of this paper are: chao-dyn
19
The categories of this paper are: eess
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio