Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multimodal Deep Models for Predicting Affective Responses Evoked by
  Movies   The goal of this study is to develop and analyze multimodal models for
predicting experienced affective responses of viewers watching movie clips. We
develop hybrid multimodal prediction models based on both the video and audio
of the clips. For the video content, we hypothesize that both image content and
motion are crucial features for evoked emotion prediction. To capture such
information, we extract features from RGB frames and optical flow using
pre-trained neural networks. For the audio model, we compute an enhanced set of
low-level descriptors including intensity, loudness, cepstrum, linear predictor
coefficients, pitch and voice quality. Both visual and audio features are then
concatenated to create audio-visual features, which are used to predict the
evoked emotion. To classify the movie clips into the corresponding affective
response categories, we propose two approaches based on deep neural network
models. The first one is based on fully connected layers without memory on the
time component, the second incorporates the sequential dependency with a long
short-term memory recurrent neural network (LSTM). We perform a thorough
analysis of the importance of each feature set. Our experiments reveal that in
our set-up, predicting emotions at each time step independently gives slightly
better accuracy performance than with the LSTM. Interestingly, we also observe
that the optical flow is more informative than the RGB in videos, and overall,
models using audio features are more accurate than those based on video
features when making the final prediction of evoked emotions.

16
The categories of this paper are: stat
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys