Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-media Similarity Metric Learning with Unified Deep Networks   As a highlighting research topic in the multimedia area, cross-media
retrieval aims to capture the complex correlations among multiple media types.
Learning better shared representation and distance metric for multimedia data
is important to boost the cross-media retrieval. Motivated by the strong
ability of deep neural network in feature representation and comparison
functions learning, we propose the Unified Network for Cross-media Similarity
Metric (UNCSM) to associate cross-media shared representation learning with
distance metric in a unified framework. First, we design a two-pathway deep
network pretrained with contrastive loss, and employ double triplet similarity
loss for fine-tuning to learn the shared representation for each media type by
modeling the relative semantic similarity. Second, the metric network is
designed for effectively calculating the cross-media similarity of the shared
representation, by modeling the pairwise similar and dissimilar constraints.
Compared to the existing methods which mostly ignore the dissimilar constraints
and only use sample distance metric as Euclidean distance separately, our UNCSM
approach unifies the representation learning and distance metric to preserve
the relative similarity as well as embrace more complex similarity functions
for further improving the cross-media retrieval accuracy. The experimental
results show that our UNCSM approach outperforms 8 state-of-the-art methods on
4 widely-used cross-media datasets.

34
The categories of this paper are: chem-ph
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
20
The categories of this paper are: acc-phys