Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Storytelling of Photo Stream with Bidirectional Multi-thread Recurrent
  Neural Network   Visual storytelling aims to generate human-level narrative language (i.e., a
natural paragraph with multiple sentences) from a photo streams. A typical
photo story consists of a global timeline with multi-thread local storylines,
where each storyline occurs in one different scene. Such complex structure
leads to large content gaps at scene transitions between consecutive photos.
Most existing image/video captioning methods can only achieve limited
performance, because the units in traditional recurrent neural networks (RNN)
tend to "forget" the previous state when the visual sequence is inconsistent.
In this paper, we propose a novel visual storytelling approach with
Bidirectional Multi-thread Recurrent Neural Network (BMRNN). First, based on
the mined local storylines, a skip gated recurrent unit (sGRU) with delay
control is proposed to maintain longer range visual information. Second, by
using sGRU as basic units, the BMRNN is trained to align the local storylines
into the global sequential timeline. Third, a new training scheme with a
storyline-constrained objective function is proposed by jointly considering
both global and local matches. Experiments on three standard storytelling
datasets show that the BMRNN model outperforms the state-of-the-art methods.

21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
35
The categories of this paper are: mtrl-th
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
4
The categories of this paper are: cond-mat
34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
6
The categories of this paper are: astro-ph
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math