Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Data-free Knowledge Distillation for Segmentation using Data-Enriching
  GAN   Distilling knowledge from huge pre-trained networks to improve the
performance of tiny networks has favored deep learning models to be used in
many real-time and mobile applications. Several approaches that demonstrate
success in this field have made use of the true training dataset to extract
relevant knowledge. In absence of the True dataset, however, extracting
knowledge from deep networks is still a challenge. Recent works on data-free
knowledge distillation demonstrate such techniques on classification tasks. To
this end, we explore the task of data-free knowledge distillation for
segmentation tasks. First, we identify several challenges specific to
segmentation. We make use of the DeGAN training framework to propose a novel
loss function for enforcing diversity in a setting where a few classes are
underrepresented. Further, we explore a new training framework for performing
knowledge distillation in a data-free setting. We get an improvement of 6.93%
in Mean IoU over previous approaches.

12
The categories of this paper are: nucl-th
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ