Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Accountable Error Characterization   Customers of machine learning systems demand accountability from the
companies employing these algorithms for various prediction tasks.
Accountability requires understanding of system limit and condition of
erroneous predictions, as customers are often interested in understanding the
incorrect predictions, and model developers are absorbed in finding methods
that can be used to get incremental improvements to an existing system.
Therefore, we propose an accountable error characterization method, AEC, to
understand when and where errors occur within the existing black-box models.
AEC, as constructed with human-understandable linguistic features, allows the
model developers to automatically identify the main sources of errors for a
given classification system. It can also be used to sample for the set of most
informative input points for a next round of training. We perform error
detection for a sentiment analysis task using AEC as a case study. Our results
on the sample sentiment task show that AEC is able to characterize erroneous
predictions into human understandable categories and also achieves promising
results on selecting erroneous samples when compared with the uncertainty-based
sampling.

14
The categories of this paper are: math-ph
2
The categories of this paper are: math
23
The categories of this paper are: solv-int
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
19
The categories of this paper are: eess
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg