Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Generating and Evaluating Explanations of Attended and Error-Inducing
  Input Regions for VQA Models   Attention maps, a popular heatmap-based explanation method for Visual
Question Answering (VQA), are supposed to help users understand the model by
highlighting portions of the image/question used by the model to infer answers.
However, we see that users are often misled by current attention map
visualizations that point to relevant regions despite the model producing an
incorrect answer. Hence, we propose Error Maps that clarify the error by
highlighting image regions where the model is prone to err. Error maps can
indicate when a correctly attended region may be processed incorrectly leading
to an incorrect answer, and hence, improve users' understanding of those cases.
To evaluate our new explanations, we further introduce a metric that simulates
users' interpretation of explanations to evaluate their potential helpfulness
to understand model correctness. We finally conduct user studies to see that
our new explanations help users understand model correctness better than
baselines by an expected 30\% and that our proxy helpfulness metrics correlate
strongly ($\rho>0.97$) with how well users can predict model correctness.

15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th
5
The categories of this paper are: gr-qc
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
2
The categories of this paper are: math
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
18
The categories of this paper are: econ