Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Numerical reasoning in machine reading comprehension tasks: are we there
  yet?   Numerical reasoning based machine reading comprehension is a task that
involves reading comprehension along with using arithmetic operations such as
addition, subtraction, sorting, and counting. The DROP benchmark (Dua et al.,
2019) is a recent dataset that has inspired the design of NLP models aimed at
solving this task. The current standings of these models in the DROP
leaderboard, over standard metrics, suggest that the models have achieved
near-human performance. However, does this mean that these models have learned
to reason? In this paper, we present a controlled study on some of the
top-performing model architectures for the task of numerical reasoning. Our
observations suggest that the standard metrics are incapable of measuring
progress towards such tasks.

27
The categories of this paper are: comp-gas
5
The categories of this paper are: gr-qc
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int