Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Evaluating Explanation Methods for Neural Machine Translation   Recently many efforts have been devoted to interpreting the black-box NMT
models, but little progress has been made on metrics to evaluate explanation
methods. Word Alignment Error Rate can be used as such a metric that matches
human understanding, however, it can not measure explanation methods on those
target words that are not aligned to any source word. This paper thereby makes
an initial attempt to evaluate explanation methods from an alternative
viewpoint. To this end, it proposes a principled metric based on fidelity in
regard to the predictive behavior of the NMT model. As the exact computation
for this metric is intractable, we employ an efficient approach as its
approximation. On six standard translation tasks, we quantitatively evaluate
several explanation methods in terms of the proposed metric and we reveal some
valuable findings for these explanation methods in our experiments.

34
The categories of this paper are: chem-ph
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ