Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: HANet: Hierarchical Alignment Networks for Video-Text Retrieval   Video-text retrieval is an important yet challenging task in vision-language
understanding, which aims to learn a joint embedding space where related video
and text instances are close to each other. Most current works simply measure
the video-text similarity based on video-level and text-level embeddings.
However, the neglect of more fine-grained or local information causes the
problem of insufficient representation. Some works exploit the local details by
disentangling sentences, but overlook the corresponding videos, causing the
asymmetry of video-text representation. To address the above limitations, we
propose a Hierarchical Alignment Network (HANet) to align different level
representations for video-text matching. Specifically, we first decompose video
and text into three semantic levels, namely event (video and text), action
(motion and verb), and entity (appearance and noun). Based on these, we
naturally construct hierarchical representations in the individual-local-global
manner, where the individual level focuses on the alignment between frame and
word, local level focuses on the alignment between video clip and textual
context, and global level focuses on the alignment between the whole video and
text. Different level alignments capture fine-to-coarse correlations between
video and text, as well as take the advantage of the complementary information
among three semantic levels. Besides, our HANet is also richly interpretable by
explicitly learning key semantic concepts. Extensive experiments on two public
datasets, namely MSR-VTT and VATEX, show the proposed HANet outperforms other
state-of-the-art methods, which demonstrates the effectiveness of hierarchical
representation and alignment. Our code is publicly available.

25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
14
The categories of this paper are: math-ph
10
The categories of this paper are: q-bio
20
The categories of this paper are: acc-phys
18
The categories of this paper are: econ
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom