Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-media Multi-level Alignment with Relation Attention Network   With the rapid growth of multimedia data, such as image and text, it is a
highly challenging problem to effectively correlate and retrieve the data of
different media types. Naturally, when correlating an image with textual
description, people focus on not only the alignment between discriminative
image regions and key words, but also the relations lying in the visual and
textual context. Relation understanding is essential for cross-media
correlation learning, which is ignored by prior cross-media retrieval works. To
address the above issue, we propose Cross-media Relation Attention Network
(CRAN) with multi-level alignment. First, we propose visual-language relation
attention model to explore both fine-grained patches and their relations of
different media types. We aim to not only exploit cross-media fine-grained
local information, but also capture the intrinsic relation information, which
can provide complementary hints for correlation learning. Second, we propose
cross-media multi-level alignment to explore global, local and relation
alignments across different media types, which can mutually boost to learn more
precise cross-media correlation. We conduct experiments on 2 cross-media
datasets, and compare with 10 state-of-the-art methods to verify the
effectiveness of proposed approach.

8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys