Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment
  Analysis   Multimodal machine learning is a core research area spanning the language,
visual and acoustic modalities. The central challenge in multimodal learning
involves learning representations that can process and relate information from
multiple modalities. In this paper, we propose two methods for unsupervised
learning of joint multimodal representations using sequence to sequence
(Seq2Seq) methods: a \textit{Seq2Seq Modality Translation Model} and a
\textit{Hierarchical Seq2Seq Modality Translation Model}. We also explore
multiple different variations on the multimodal inputs and outputs of these
seq2seq models. Our experiments on multimodal sentiment analysis using the
CMU-MOSI dataset indicate that our methods learn informative multimodal
representations that outperform the baselines and achieve improved performance
on multimodal sentiment analysis, specifically in the Bimodal case where our
model is able to improve F1 Score by twelve points. We also discuss future
directions for multimodal Seq2Seq methods.

18
The categories of this paper are: econ
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph