Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Audio-Visual Event Localization via Recursive Fusion by Joint
  Co-Attention   The major challenge in audio-visual event localization task lies in how to
fuse information from multiple modalities effectively. Recent works have shown
that attention mechanism is beneficial to the fusion process. In this paper, we
propose a novel joint attention mechanism with multimodal fusion methods for
audio-visual event localization. Particularly, we present a concise yet valid
architecture that effectively learns representations from multiple modalities
in a joint manner. Initially, visual features are combined with auditory
features and then turned into joint representations. Next, we make use of the
joint representations to attend to visual features and auditory features,
respectively. With the help of this joint co-attention, new visual and auditory
features are produced, and thus both features can enjoy the mutually improved
benefits from each other. It is worth noting that the joint co-attention unit
is recursive meaning that it can be performed multiple times for obtaining
better joint representations progressively. Extensive experiments on the public
AVE dataset have shown that the proposed method achieves significantly better
results than the state-of-the-art methods.

13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
5
The categories of this paper are: gr-qc
2
The categories of this paper are: math
31
The categories of this paper are: ao-sci
27
The categories of this paper are: comp-gas
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
16
The categories of this paper are: stat
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph