Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: CO2Sum:Contrastive Learning for Factual-Consistent Abstractive
  Summarization   Generating factual-consistent summaries is a challenging task for abstractive
summarization. Previous works mainly encode factual information or perform
post-correct/rank after decoding. In this paper, we provide a
factual-consistent solution from the perspective of contrastive learning, which
is a natural extension of previous works. We propose CO2Sum (Contrastive for
Consistency), a contrastive learning scheme that can be easily applied on
sequence-to-sequence models for factual-consistent abstractive summarization,
proving that the model can be fact-aware without modifying the architecture.
CO2Sum applies contrastive learning on the encoder, which can help the model be
aware of the factual information contained in the input article, or performs
contrastive learning on the decoder, which makes the model to generate
factual-correct output summary. What's more, these two schemes are orthogonal
and can be combined to further improve faithfulness. Comprehensive experiments
on public benchmarks demonstrate that CO2Sum improves the faithfulness on large
pre-trained language models and reaches competitive results compared to other
strong factual-consistent summarization baselines.

12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
5
The categories of this paper are: gr-qc
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
2
The categories of this paper are: math
31
The categories of this paper are: ao-sci
28
The categories of this paper are: alg-geom
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
6
The categories of this paper are: astro-ph