Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Temporal Relational Reasoning in Videos   Temporal relational reasoning, the ability to link meaningful transformations
of objects or entities over time, is a fundamental property of intelligent
species. In this paper, we introduce an effective and interpretable network
module, the Temporal Relation Network (TRN), designed to learn and reason about
temporal dependencies between video frames at multiple time scales. We evaluate
TRN-equipped networks on activity recognition tasks using three recent video
datasets - Something-Something, Jester, and Charades - which fundamentally
depend on temporal relational reasoning. Our results demonstrate that the
proposed TRN gives convolutional neural networks a remarkable capacity to
discover temporal relations in videos. Through only sparsely sampled video
frames, TRN-equipped networks can accurately predict human-object interactions
in the Something-Something dataset and identify various human gestures on the
Jester dataset with very competitive performance. TRN-equipped networks also
outperform two-stream networks and 3D convolution networks in recognizing daily
activities in the Charades dataset. Further analyses show that the models learn
intuitive and interpretable visual common sense knowledge in videos.

35
The categories of this paper are: mtrl-th
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an