Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Better and Faster: Knowledge Transfer from Multiple Self-supervised
  Learning Tasks via Graph Distillation for Video Classification   Video representation learning is a vital problem for classification task.
Recently, a promising unsupervised paradigm termed self-supervised learning has
emerged, which explores inherent supervisory signals implied in massive data
for feature learning via solving auxiliary tasks. However, existing methods in
this regard suffer from two limitations when extended to video classification.
First, they focus only on a single task, whereas ignoring complementarity among
different task-specific features and thus resulting in suboptimal video
representation. Second, high computational and memory cost hinders their
application in real-world scenarios. In this paper, we propose a graph-based
distillation framework to address these problems: (1) We propose logits graph
and representation graph to transfer knowledge from multiple self-supervised
tasks, where the former distills classifier-level knowledge by solving a
multi-distribution joint matching problem, and the latter distills internal
feature knowledge from pairwise ensembled representations with tackling the
challenge of heterogeneity among different features; (2) The proposal that
adopts a teacher-student framework can reduce the redundancy of knowledge
learnt from teachers dramatically, leading to a lighter student model that
solves classification task more efficiently. Experimental results on 3 video
datasets validate that our proposal not only helps learn better video
representation but also compress model for faster inference.

14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
30
The categories of this paper are: q-alg
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
23
The categories of this paper are: solv-int