Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Actor-Context-Actor Relation Network for Spatio-Temporal Action
  Localization   Localizing persons and recognizing their actions from videos is a challenging
task towards high-level video understanding. Recent advances have been achieved
by modeling direct pairwise relations between entities. In this paper, we take
one step further, not only model direct relations between pairs but also take
into account indirect higher-order relations established upon multiple
elements. We propose to explicitly model the Actor-Context-Actor Relation,
which is the relation between two actors based on their interactions with the
context. To this end, we design an Actor-Context-Actor Relation Network
(ACAR-Net) which builds upon a novel High-order Relation Reasoning Operator and
an Actor-Context Feature Bank to enable indirect relation reasoning for
spatio-temporal action localization. Experiments on AVA and UCF101-24 datasets
show the advantages of modeling actor-context-actor relations, and
visualization of attention maps further verifies that our model is capable of
finding relevant higher-order relations to support action detection. Notably,
our method ranks first in the AVA-Kineticsaction localization task of
ActivityNet Challenge 2020, out-performing other entries by a significant
margin (+6.71mAP). Training code and models will be available at
https://github.com/Siyu-C/ACAR-Net.

18
The categories of this paper are: econ
26
The categories of this paper are: bayes-an
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
33
The categories of this paper are: plasm-ph
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th