Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modeling Multi-Label Action Dependencies for Temporal Action
  Localization   Real-world videos contain many complex actions with inherent relationships
between action classes. In this work, we propose an attention-based
architecture that models these action relationships for the task of temporal
action localization in untrimmed videos. As opposed to previous works that
leverage video-level co-occurrence of actions, we distinguish the relationships
between actions that occur at the same time-step and actions that occur at
different time-steps (i.e. those which precede or follow each other). We define
these distinct relationships as action dependencies. We propose to improve
action localization performance by modeling these action dependencies in a
novel attention-based Multi-Label Action Dependency (MLAD)layer. The MLAD layer
consists of two branches: a Co-occurrence Dependency Branch and a Temporal
Dependency Branch to model co-occurrence action dependencies and temporal
action dependencies, respectively. We observe that existing metrics used for
multi-label classification do not explicitly measure how well action
dependencies are modeled, therefore, we propose novel metrics that consider
both co-occurrence and temporal dependencies between action classes. Through
empirical evaluation and extensive analysis, we show improved performance over
state-of-the-art methods on multi-label action localization
benchmarks(MultiTHUMOS and Charades) in terms of f-mAP and our proposed metric.

5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
24
The categories of this paper are: dg-ga
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg