Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Explaining by Removing: A Unified Framework for Model Explanation   Researchers have proposed a wide variety of model explanation approaches, but
it remains unclear how most methods are related or when one method is
preferable to another. We establish a new class of methods, removal-based
explanations, that are based on the principle of simulating feature removal to
quantify each feature's influence. These methods vary in several respects, so
we develop a framework that characterizes each method along three dimensions:
1) how the method removes features, 2) what model behavior the method explains,
and 3) how the method summarizes each feature's influence. Our framework
unifies 25 existing methods, including several of the most widely used
approaches (SHAP, LIME, Meaningful Perturbations, permutation tests). This new
class of explanation methods has rich connections that we examine using tools
that have been largely overlooked by the explainability literature. To anchor
removal-based explanations in cognitive psychology, we show that feature
removal is a simple application of subtractive counterfactual reasoning. Ideas
from cooperative game theory shed light on the relationships and trade-offs
among different methods, and we derive conditions under which all removal-based
explanations have information-theoretic interpretations. Through this analysis,
we develop a unified framework that helps practitioners better understand model
explanation tools, and that offers a strong theoretical foundation upon which
future explainability research can build.

14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
21
The categories of this paper are: adap-org