Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Outlier Detection for Improved Data Quality and Diversity in Dialog
  Systems   In a corpus of data, outliers are either errors: mistakes in the data that
are counterproductive, or are unique: informative samples that improve model
robustness. Identifying outliers can lead to better datasets by (1) removing
noise in datasets and (2) guiding collection of additional data to fill gaps.
However, the problem of detecting both outlier types has received relatively
little attention in NLP, particularly for dialog systems. We introduce a simple
and effective technique for detecting both erroneous and unique samples in a
corpus of short texts using neural sentence embeddings combined with
distance-based outlier detection. We also present a novel data collection
pipeline built atop our detection technique to automatically and iteratively
mine unique data samples while discarding erroneous samples. Experiments show
that our outlier detection technique is effective at finding errors while our
data collection pipeline yields highly diverse corpora that in turn produce
more robust intent classification and slot-filling models.

34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
19
The categories of this paper are: eess
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
12
The categories of this paper are: nucl-th
2
The categories of this paper are: math