Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Video Storytelling: Textual Summaries for Events   Bridging vision and natural language is a longstanding goal in computer
vision and multimedia research. While earlier works focus on generating a
single-sentence description for visual content, recent works have studied
paragraph generation. In this work, we introduce the problem of video
storytelling, which aims at generating coherent and succinct stories for long
videos. Video storytelling introduces new challenges, mainly due to the
diversity of the story and the length and complexity of the video. We propose
novel methods to address the challenges. First, we propose a context-aware
framework for multimodal embedding learning, where we design a Residual
Bidirectional Recurrent Neural Network to leverage contextual information from
past and future. Second, we propose a Narrator model to discover the underlying
storyline. The Narrator is formulated as a reinforcement learning agent which
is trained by directly optimizing the textual metric of the generated story. We
evaluate our method on the Video Story dataset, a new dataset that we have
collected to enable the study. We compare our method with multiple
state-of-the-art baselines, and show that our method achieves better
performance, in terms of quantitative measures and user study.

33
The categories of this paper are: plasm-ph
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
16
The categories of this paper are: stat
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
19
The categories of this paper are: eess