Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: To Test Machine Comprehension, Start by Defining Comprehension   Many tasks aim to measure machine reading comprehension (MRC), often focusing
on question types presumed to be difficult. Rarely, however, do task designers
start by considering what systems should in fact comprehend. In this paper we
make two key contributions. First, we argue that existing approaches do not
adequately define comprehension; they are too unsystematic about what content
is tested. Second, we present a detailed definition of comprehension -- a
"Template of Understanding" -- for a widely useful class of texts, namely short
narratives. We then conduct an experiment that strongly suggests existing
systems are not up to the task of narrative understanding as we define it.

34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
20
The categories of this paper are: acc-phys
0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
2
The categories of this paper are: math
27
The categories of this paper are: comp-gas