Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Describing Videos by Exploiting Temporal Structure   Recent progress in using recurrent neural networks (RNNs) for image
description has motivated the exploration of their application for video
description. However, while images are static, working with videos requires
modeling their dynamic temporal structure and then properly integrating that
information into a natural language description. In this context, we propose an
approach that successfully takes into account both the local and global
temporal structure of videos to produce descriptions. First, our approach
incorporates a spatial temporal 3-D convolutional neural network (3-D CNN)
representation of the short temporal dynamics. The 3-D CNN representation is
trained on video action recognition tasks, so as to produce a representation
that is tuned to human motion and behavior. Second we propose a temporal
attention mechanism that allows to go beyond local temporal modeling and learns
to automatically select the most relevant temporal segments given the
text-generating RNN. Our approach exceeds the current state-of-art for both
BLEU and METEOR metrics on the Youtube2Text dataset. We also present results on
a new, larger and more challenging dataset of paired video and natural language
descriptions.

7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
19
The categories of this paper are: eess
6
The categories of this paper are: astro-ph
29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics