Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adversarial Examples for Evaluating Math Word Problem Solvers   Standard accuracy metrics have shown that Math Word Problem (MWP) solvers
have achieved high performance on benchmark datasets. However, the extent to
which existing MWP solvers truly understand language and its relation with
numbers is still unclear. In this paper, we generate adversarial attacks to
evaluate the robustness of state-of-the-art MWP solvers. We propose two methods
Question Reordering and Sentence Paraphrasing to generate adversarial attacks.
We conduct experiments across three neural MWP solvers over two benchmark
datasets. On average, our attack method is able to reduce the accuracy of MWP
solvers by over 40 percentage points on these datasets. Our results demonstrate
that existing MWP solvers are sensitive to linguistic variations in the problem
text. We verify the validity and quality of generated adversarial examples
through human evaluation.

34
The categories of this paper are: chem-ph
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat
22
The categories of this paper are: chao-dyn
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an