Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adaptive Instance Distillation for Object Detection in Autonomous
  Driving   In recent years, knowledge distillation (KD) has been widely used as an
effective way to derive efficient models. Through imitating a large teacher
model, a lightweight student model can achieve comparable performance with more
efficiency. However, most existing knowledge distillation methods are focused
on classification tasks. Only a limited number of studies have applied
knowledge distillation to object detection, especially in time-sensitive
autonomous driving scenarios. We propose the Adaptive Instance Distillation
(AID) method to selectively impart knowledge from the teacher to the student
for improving the performance of knowledge distillation. Unlike previous KD
methods that treat all instances equally, our AID can attentively adjust the
distillation weights of instances based on the teacher model's prediction loss.
We verified the effectiveness of our AID method through experiments on the
KITTI and the COCO traffic datasets. The results show that our method improves
the performance of existing state-of-the-art attention-guided and non-local
distillation methods and achieves better distillation results on both
single-stage and two-stage detectors. Compared to the baseline, our AID led to
an average of 2.7% and 2.05% mAP increases for single-stage and two-stage
detectors, respectively. Furthermore, our AID is also shown to be useful for
self-distillation to improve the teacher model's performance.

31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
3
The categories of this paper are: physics
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom