Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: G-DetKD: Towards General Distillation Framework for Object Detectors via
  Contrastive and Semantic-guided Feature Imitation   In this paper, we investigate the knowledge distillation (KD) strategy for
object detection and propose an effective framework applicable to both
homogeneous and heterogeneous student-teacher pairs. The conventional feature
imitation paradigm introduces imitation masks to focus on informative
foreground areas while excluding the background noises. However, we find that
those methods fail to fully utilize the semantic information in all feature
pyramid levels, which leads to inefficiency for knowledge distillation between
FPN-based detectors. To this end, we propose a novel semantic-guided feature
imitation technique, which automatically performs soft matching between feature
pairs across all pyramid levels to provide the optimal guidance to the student.
To push the envelop even further, we introduce contrastive distillation to
effectively capture the information encoded in the relationship between
different feature regions. Finally, we propose a generalized detection KD
pipeline, which is capable of distilling both homogeneous and heterogeneous
detector pairs. Our method consistently outperforms the existing detection KD
techniques, and works when (1) components in the framework are used separately
and in conjunction; (2) for both homogeneous and heterogenous student-teacher
pairs and (3) on multiple detection benchmarks. With a powerful
X101-FasterRCNN-Instaboost detector as the teacher, R50-FasterRCNN reaches
44.0% AP, R50-RetinaNet reaches 43.3% AP and R50-FCOS reaches 43.1% AP on COCO
dataset.

8
The categories of this paper are: hep-ex
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
20
The categories of this paper are: acc-phys
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex