Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Repetitive Activity Counting by Sight and Sound   This paper strives for repetitive activity counting in videos. Different from
existing works, which all analyze the visual video content only, we incorporate
for the first time the corresponding sound into the repetition counting
process. This benefits accuracy in challenging vision conditions such as
occlusion, dramatic camera view changes, low resolution, etc. We propose a
model that starts with analyzing the sight and sound streams separately. Then
an audiovisual temporal stride decision module and a reliability estimation
module are introduced to exploit cross-modal temporal interaction. For learning
and evaluation, an existing dataset is repurposed and reorganized to allow for
repetition counting with sight and sound. We also introduce a variant of this
dataset for repetition counting under challenging vision conditions.
Experiments demonstrate the benefit of sound, as well as the other introduced
modules, for repetition counting. Our sight-only model already outperforms the
state-of-the-art by itself, when we add sound, results improve notably,
especially under harsh vision conditions.

2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
20
The categories of this paper are: acc-phys
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
10
The categories of this paper are: q-bio
19
The categories of this paper are: eess
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat