Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: UniMS: A Unified Framework for Multimodal Summarization with Knowledge
  Distillation   With the rapid increase of multimedia data, a large body of literature has
emerged to work on multimodal summarization, the majority of which target at
refining salient information from textual and visual modalities to output a
pictorial summary with the most relevant images. Existing methods mostly focus
on either extractive or abstractive summarization and rely on qualified image
captions to build image references. We are the first to propose a Unified
framework for Multimodal Summarization grounding on BART, UniMS, that
integrates extractive and abstractive objectives, as well as selecting the
image output. Specially, we adopt knowledge distillation from a vision-language
pretrained model to improve image selection, which avoids any requirement on
the existence and quality of image captions. Besides, we introduce a visual
guided decoder to better integrate textual and visual modalities in guiding
abstractive text generation. Results show that our best model achieves a new
state-of-the-art result on a large-scale benchmark dataset. The newly involved
extractive objective as well as the knowledge distillation technique are proven
to bring a noticeable improvement to the multimodal summarization task.

0
The categories of this paper are: hep-ph
10
The categories of this paper are: q-bio
4
The categories of this paper are: cond-mat
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
26
The categories of this paper are: bayes-an
6
The categories of this paper are: astro-ph
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
16
The categories of this paper are: stat
31
The categories of this paper are: ao-sci