Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Glimpse Clouds: Human Activity Recognition from Unstructured Feature
  Points   We propose a method for human activity recognition from RGB data that does
not rely on any pose information during test time and does not explicitly
calculate pose information internally. Instead, a visual attention module
learns to predict glimpse sequences in each frame. These glimpses correspond to
interest points in the scene that are relevant to the classified activities. No
spatial coherence is forced on the glimpse locations, which gives the module
liberty to explore different points at each frame and better optimize the
process of scrutinizing visual information. Tracking and sequentially
integrating this kind of unstructured data is a challenge, which we address by
separating the set of glimpses from a set of recurrent tracking/recognition
workers. These workers receive glimpses, jointly performing subsequent motion
tracking and activity prediction. The glimpses are soft-assigned to the
workers, optimizing coherence of the assignments in space, time and feature
space using an external memory module. No hard decisions are taken, i.e. each
glimpse point is assigned to all existing workers, albeit with different
importance. Our methods outperform state-of-the-art methods on the largest
human activity recognition dataset available to-date; NTU RGB+D Dataset, and on
a smaller human action recognition dataset Northwestern-UCLA Multiview Action
3D Dataset. Our code is publicly available at
https://github.com/fabienbaradel/glimpse_clouds.

23
The categories of this paper are: solv-int
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
20
The categories of this paper are: acc-phys
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
32
The categories of this paper are: atom-ph
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
36
The categories of this paper are: cmp-lg