Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Omni-sourced Webly-supervised Learning for Video Recognition   We introduce OmniSource, a novel framework for leveraging web data to train
video recognition models. OmniSource overcomes the barriers between data
formats, such as images, short videos, and long untrimmed videos for
webly-supervised learning. First, data samples with multiple formats, curated
by task-specific data collection and automatically filtered by a teacher model,
are transformed into a unified form. Then a joint-training strategy is proposed
to deal with the domain gaps between multiple data sources and formats in
webly-supervised learning. Several good practices, including data balancing,
resampling, and cross-dataset mixup are adopted in joint training. Experiments
show that by utilizing data from multiple sources and formats, OmniSource is
more data-efficient in training. With only 3.5M images and 800K minutes videos
crawled from the internet without human labeling (less than 2% of prior works),
our models learned with OmniSource improve Top-1 accuracy of 2D- and 3D-ConvNet
baseline models by 3.0% and 3.9%, respectively, on the Kinetics-400 benchmark.
With OmniSource, we establish new records with different pretraining strategies
for video recognition. Our best models achieve 80.4%, 80.5%, and 83.6 Top-1
accuracies on the Kinetics-400 benchmark respectively for
training-from-scratch, ImageNet pre-training and IG-65M pre-training.

3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th