Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SemBleu: A Robust Metric for AMR Parsing Evaluation   Evaluating AMR parsing accuracy involves comparing pairs of AMR graphs. The
major evaluation metric, SMATCH (Cai and Knight, 2013), searches for one-to-one
mappings between the nodes of two AMRs with a greedy hill-climbing algorithm,
which leads to search errors. We propose SEMBLEU, a robust metric that extends
BLEU (Papineni et al., 2002) to AMRs. It does not suffer from search errors and
considers non-local correspondences in addition to local ones. SEMBLEU is fully
content-driven and punishes situations where a system's output does not
preserve most information from the input. Preliminary experiments on both
sentence and corpus levels show that SEMBLEU has slightly higher consistency
with human judgments than SMATCH. Our code is available at
http://github.com/freesunshine0316/sembleu.

9
The categories of this paper are: nlin
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys