Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modality to Modality Translation: An Adversarial Representation Learning
  and Graph Fusion Network for Multimodal Fusion   Learning joint embedding space for various modalities is of vital importance
for multimodal fusion. Mainstream modality fusion approaches fail to achieve
this goal, leaving a modality gap which heavily affects cross-modal fusion. In
this paper, we propose a novel adversarial encoder-decoder-classifier framework
to learn a modality-invariant embedding space. Since the distributions of
various modalities vary in nature, to reduce the modality gap, we translate the
distributions of source modalities into that of target modality via their
respective encoders using adversarial training. Furthermore, we exert
additional constraints on embedding space by introducing reconstruction loss
and classification loss. Then we fuse the encoded representations using
hierarchical graph neural network which explicitly explores unimodal, bimodal
and trimodal interactions in multi-stage. Our method achieves state-of-the-art
performance on multiple datasets. Visualization of the learned embeddings
suggests that the joint embedding space learned by our method is
discriminative. code is available at:
\url{https://github.com/TmacMai/ARGF_multimodal_fusion}

26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
5
The categories of this paper are: gr-qc
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
9
The categories of this paper are: nlin
16
The categories of this paper are: stat
24
The categories of this paper are: dg-ga