Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Weakly-supervised Action Localization with Background Modeling   We describe a latent approach that learns to detect actions in long sequences
given training videos with only whole-video class labels. Our approach makes
use of two innovations to attention-modeling in weakly-supervised learning.
First, and most notably, our framework uses an attention model to extract both
foreground and background frames whose appearance is explicitly modeled. Most
prior works ignore the background, but we show that modeling it allows our
system to learn a richer notion of actions and their temporal extents. Second,
we combine bottom-up, class-agnostic attention modules with top-down,
class-specific activation maps, using the latter as form of self-supervision
for the former. Doing so allows our model to learn a more accurate model of
attention without explicit temporal supervision. These modifications lead to
10% AP@IoU=0.5 improvement over existing systems on THUMOS14. Our proposed
weaklysupervised system outperforms recent state-of-the-arts by at least 4.3%
AP@IoU=0.5. Finally, we demonstrate that weakly-supervised learning can be used
to aggressively scale-up learning to in-the-wild, uncurated Instagram videos.
The addition of these videos significantly improves localization performance of
our weakly-supervised model

0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
12
The categories of this paper are: nucl-th
19
The categories of this paper are: eess
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
11
The categories of this paper are: hep-lat
3
The categories of this paper are: physics