Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Veracity of Local, Model-agnostic Explanations in Audio
  Classification: Targeted Investigations with Adversarial Examples   Local explanation methods such as LIME have become popular in MIR as tools
for generating post-hoc, model-agnostic explanations of a model's
classification decisions. The basic idea is to identify a small set of
human-understandable features of the classified example that are most
influential on the classifier's prediction. These are then presented as an
explanation. Evaluation of such explanations in publications often resorts to
accepting what matches the expectation of a human without actually being able
to verify if what the explanation shows is what really caused the model's
prediction. This paper reports on targeted investigations where we try to get
more insight into the actual veracity of LIME's explanations in an audio
classification task. We deliberately design adversarial examples for the
classifier, in a way that gives us knowledge about which parts of the input are
potentially responsible for the model's (wrong) prediction. Asking LIME to
explain the predictions for these adversaries permits us to study whether local
explanations do indeed detect these regions of interest. We also look at
whether LIME is more successful in finding perturbations that are more
prominent and easily noticeable for a human. Our results suggest that LIME does
not necessarily manage to identify the most relevant input features and hence
it remains unclear whether explanations are useful or even misleading.

36
The categories of this paper are: cmp-lg
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org