Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SeCo: Exploring Sequence Supervision for Unsupervised Representation
  Learning   A steady momentum of innovations and breakthroughs has convincingly pushed
the limits of unsupervised image representation learning. Compared to static 2D
images, video has one more dimension (time). The inherent supervision existing
in such sequential structure offers a fertile ground for building unsupervised
learning models. In this paper, we compose a trilogy of exploring the basic and
generic supervision in the sequence from spatial, spatiotemporal and sequential
perspectives. We materialize the supervisory signals through determining
whether a pair of samples is from one frame or from one video, and whether a
triplet of samples is in the correct temporal order. We uniquely regard the
signals as the foundation in contrastive learning and derive a particular form
named Sequence Contrastive Learning (SeCo). SeCo shows superior results under
the linear protocol on action recognition (Kinetics), untrimmed activity
recognition (ActivityNet) and object tracking (OTB-100). More remarkably, SeCo
demonstrates considerable improvements over recent unsupervised pre-training
techniques, and leads the accuracy by 2.96% and 6.47% against fully-supervised
ImageNet pre-training in action recognition task on UCF101 and HMDB51,
respectively. Source code is available at
\url{https://github.com/YihengZhang-CV/SeCo-Sequence-Contrastive-Learning}.

29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex