Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Roadmap of Designing Cognitive Metrics for Explainable Artificial
  Intelligence (XAI)   More recently, Explainable Artificial Intelligence (XAI) research has shifted
to focus on a more pragmatic or naturalistic account of understanding, that is,
whether the stakeholders understand the explanation. This point is especially
important for research on evaluation methods for XAI systems. Thus, another
direction where XAI research can benefit significantly from cognitive science
and psychology research is ways to measure understanding of users, responses
and attitudes. These measures can be used to quantify explanation quality and
as feedback to the XAI system to improve the explanations. The current report
aims to propose suitable metrics for evaluating XAI systems from the
perspective of the cognitive states and processes of stakeholders. We elaborate
on 7 dimensions, i.e., goodness, satisfaction, user understanding, curiosity &
engagement, trust & reliance, controllability & interactivity, and learning
curve & productivity, together with the recommended subjective and objective
psychological measures. We then provide more details about how we can use the
recommended measures to evaluate a visual classification XAI system according
to the recommended cognitive metrics.

20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
4
The categories of this paper are: cond-mat
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th