Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Interpreting Language Models with Contrastive Explanations   Model interpretability methods are often used to explain NLP model decisions
on tasks such as text classification, where the output space is relatively
small. However, when applied to language generation, where the output space
often consists of tens of thousands of tokens, these methods are unable to
provide informative explanations. Language models must consider various
features to predict a token, such as its part of speech, number, tense, or
semantics. Existing explanation methods conflate evidence for all these
features into a single explanation, which is less interpretable for human
understanding.
  To disentangle the different decisions in language modeling, we focus on
explaining language models contrastively: we look for salient input tokens that
explain why the model predicted one token instead of another. We demonstrate
that contrastive explanations are quantifiably better than non-contrastive
explanations in verifying major grammatical phenomena, and that they
significantly improve contrastive model simulatability for human observers. We
also identify groups of contrastive decisions where the model uses similar
evidence, and we are able to characterize what input tokens models use during
various language generation decisions.

22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
16
The categories of this paper are: stat
10
The categories of this paper are: q-bio
8
The categories of this paper are: hep-ex
31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
23
The categories of this paper are: solv-int