Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Semantic Image Networks for Human Action Recognition   In this paper, we propose the use of a semantic image, an improved
representation for video analysis, principally in combination with Inception
networks. The semantic image is obtained by applying localized sparse
segmentation using global clustering (LSSGC) prior to the approximate rank
pooling which summarizes the motion characteristics in single or multiple
images. It incorporates the background information by overlaying a static
background from the window onto the subsequent segmented frames. The idea is to
improve the action-motion dynamics by focusing on the region which is important
for action recognition and encoding the temporal variances using the frame
ranking method. We also propose the sequential combination of
Inception-ResNetv2 and long-short-term memory network (LSTM) to leverage the
temporal variances for improved recognition performance. Extensive analysis has
been carried out on UCF101 and HMDB51 datasets which are widely used in action
recognition studies. We show that (i) the semantic image generates better
activations and converges faster than its original variant, (ii) using
segmentation prior to approximate rank pooling yields better recognition
performance, (iii) The use of LSTM leverages the temporal variance information
from approximate rank pooling to model the action behavior better than the base
network, (iv) the proposed representations can be adaptive as they can be used
with existing methods such as temporal segment networks to improve the
recognition performance, and (v) our proposed four-stream network architecture
comprising of semantic images and semantic optical flows achieves
state-of-the-art performance, 95.9% and 73.5% recognition accuracy on UCF101
and HMDB51, respectively.

19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
16
The categories of this paper are: stat
4
The categories of this paper are: cond-mat
22
The categories of this paper are: chao-dyn
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga