Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: MOCHA: A Dataset for Training and Evaluating Generative Reading
  Comprehension Metrics   Posing reading comprehension as a generation problem provides a great deal of
flexibility, allowing for open-ended questions with few restrictions on
possible answers. However, progress is impeded by existing generation metrics,
which rely on token overlap and are agnostic to the nuances of reading
comprehension. To address this, we introduce a benchmark for training and
evaluating generative reading comprehension metrics: MOdeling Correctness with
Human Annotations. MOCHA contains 40K human judgement scores on model outputs
from 6 diverse question answering datasets and an additional set of minimal
pairs for evaluation. Using MOCHA, we train a Learned Evaluation metric for
Reading Comprehension, LERC, to mimic human judgement scores. LERC outperforms
baseline metrics by 10 to 36 absolute Pearson points on held-out annotations.
When we evaluate robustness on minimal pairs, LERC achieves 80% accuracy,
outperforming baselines by 14 to 26 absolute percentage points while leaving
significant room for improvement. MOCHA presents a challenging problem for
developing accurate and robust generative reading comprehension metrics.

2
The categories of this paper are: math
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
28
The categories of this paper are: alg-geom
6
The categories of this paper are: astro-ph