Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: WIDAR -- Weighted Input Document Augmented ROUGE   The task of automatic text summarization has gained a lot of traction due to
the recent advancements in machine learning techniques. However, evaluating the
quality of a generated summary remains to be an open problem. The literature
has widely adopted Recall-Oriented Understudy for Gisting Evaluation (ROUGE) as
the standard evaluation metric for summarization. However, ROUGE has some
long-established limitations; a major one being its dependence on the
availability of good quality reference summary. In this work, we propose the
metric WIDAR which in addition to utilizing the reference summary uses also the
input document in order to evaluate the quality of the generated summary. The
proposed metric is versatile, since it is designed to adapt the evaluation
score according to the quality of the reference summary. The proposed metric
correlates better than ROUGE by 26%, 76%, 82%, and 15%, respectively, in
coherence, consistency, fluency, and relevance on human judgement scores
provided in the SummEval dataset. The proposed metric is able to obtain
comparable results with other state-of-the-art metrics while requiring a
relatively short computational time.

15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas