Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Explicit and Implicit Latent Common Spaces for Audio-Visual
  Cross-Modal Retrieval   Learning common subspace is prevalent way in cross-modal retrieval to solve
the problem of data from different modalities having inconsistent distributions
and representations that cannot be directly compared. Previous cross-modal
retrieval methods focus on projecting the cross-modal data into a common space
by learning the correlation between them to bridge the modality gap. However,
the rich semantic information in the video and the heterogeneous nature of
audio-visual data leads to more serious heterogeneous gaps intuitively, which
may lead to the loss of key semantic content of video with single clue by the
previous methods when eliminating the modality gap, while the semantics of the
categories may undermine the properties of the original features. In this work,
we aim to learn effective audio-visual representations to support audio-visual
cross-modal retrieval (AVCMR). We propose a novel model that maps audio-visual
modalities into two distinct shared latent subspaces: explicit and implicit
shared spaces. In particular, the explicit shared space is used to optimize
pairwise correlations, where learned representations across modalities capture
the commonalities of audio-visual pairs and reduce the modality gap. The
implicit shared space is used to preserve the distinctive features between
modalities by maintaining the discrimination of audio/video patterns from
different semantic categories. Finally, the fusion of the features learned from
the two latent subspaces is used for the similarity computation of the AVCMR
task. The comprehensive experimental results on two audio-visual datasets
demonstrate that our proposed model for using two different latent subspaces
for audio-visual cross-modal learning is effective and significantly
outperforms the state-of-the-art cross-modal models that learn features from a
single subspace.

32
The categories of this paper are: atom-ph
2
The categories of this paper are: math
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con
3
The categories of this paper are: physics
27
The categories of this paper are: comp-gas
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat