Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: LGD: Label-guided Self-distillation for Object Detection   In this paper, we propose the first self-distillation framework for general
object detection, termed LGD (Label-Guided self-Distillation). Previous studies
rely on a strong pretrained teacher to provide instructive knowledge that could
be unavailable in real-world scenarios. Instead, we generate an instructive
knowledge based only on student representations and regular labels. Our
framework includes sparse label-appearance encoder, inter-object relation
adapter and intra-object knowledge mapper that jointly form an implicit teacher
at training phase, dynamically dependent on labels and evolving student
representations. They are trained end-to-end with detector and discarded in
inference. Experimentally, LGD obtains decent results on various detectors,
datasets, and extensive tasks like instance segmentation. For example in
MS-COCO dataset, LGD improves RetinaNet with ResNet-50 under 2x single-scale
training from 36.2% to 39.0% mAP (+ 2.8%). It boosts much stronger detectors
like FCOS with ResNeXt-101 DCN v2 under 2x multi-scale training from 46.1% to
47.9% (+ 1.8%). Compared with a classical teacher-based method FGFI, LGD not
only performs better without requiring pretrained teacher but also reduces 51%
training cost beyond inherent student learning. Codes are available at
https://github.com/megvii-research/LGD.

5
The categories of this paper are: gr-qc
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat