Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Class-Discriminative CNN Compression   Compressing convolutional neural networks (CNNs) by pruning and distillation
has received ever-increasing focus in the community. In particular, designing a
class-discrimination based approach would be desired as it fits seamlessly with
the CNNs training objective. In this paper, we propose class-discriminative
compression (CDC), which injects class discrimination in both pruning and
distillation to facilitate the CNNs training goal. We first study the
effectiveness of a group of discriminant functions for channel pruning, where
we include well-known single-variate binary-class statistics like Student's
T-Test in our study via an intuitive generalization. We then propose a novel
layer-adaptive hierarchical pruning approach, where we use a coarse class
discrimination scheme for early layers and a fine one for later layers. This
method naturally accords with the fact that CNNs process coarse semantics in
the early layers and extract fine concepts at the later. Moreover, we leverage
discriminant component analysis (DCA) to distill knowledge of intermediate
representations in a subspace with rich discriminative information, which
enhances hidden layers' linear separability and classification accuracy of the
student. Combining pruning and distillation, CDC is evaluated on CIFAR and
ILSVRC 2012, where we consistently outperform the state-of-the-art results.

33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
11
The categories of this paper are: hep-lat
2
The categories of this paper are: math
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
10
The categories of this paper are: q-bio
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc
6
The categories of this paper are: astro-ph