Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Three New Methods for Evaluating Reference Resolution   Reference resolution on extended texts (several thousand references) cannot
be evaluated manually. An evaluation algorithm has been proposed for the MUC
tests, using equivalence classes for the coreference relation. However, we show
here that this algorithm is too indulgent, yielding good scores even for poor
resolution strategies. We elaborate on the same formalism to propose two new
evaluation algorithms, comparing them first with the MUC algorithm and giving
then results on a variety of examples. A third algorithm using only
distributional comparison of equivalence classes is finally described; it
assesses the relative importance of the recall vs. precision errors.

25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
4
The categories of this paper are: cond-mat
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
34
The categories of this paper are: chem-ph
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
0
The categories of this paper are: hep-ph
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph