Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Explaining Your Explanations of BERT: An Empirical Study with
  Sequence Classification   BERT, as one of the pretrianed language models, attracts the most attention
in recent years for creating new benchmarks across GLUE tasks via fine-tuning.
One pressing issue is to open up the blackbox and explain the decision makings
of BERT. A number of attribution techniques have been proposed to explain BERT
models, but are often limited to sequence to sequence tasks. In this paper, we
adapt existing attribution methods on explaining decision makings of BERT in
sequence classification tasks. We conduct extensive analyses of four existing
attribution methods by applying them to four different datasets in sentiment
analysis. We compare the reliability and robustness of each method via various
ablation studies. Furthermore, we test whether attribution methods explain
generalized semantics across semantically similar tasks. Our work provides
solid guidance for using attribution methods to explain decision makings of
BERT for downstream classification tasks.

3
The categories of this paper are: physics
27
The categories of this paper are: comp-gas
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
2
The categories of this paper are: math
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th