Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ThiNet: A Filter Level Pruning Method for Deep Neural Network
  Compression   We propose an efficient and unified framework, namely ThiNet, to
simultaneously accelerate and compress CNN models in both training and
inference stages. We focus on the filter level pruning, i.e., the whole filter
would be discarded if it is less important. Our method does not change the
original network structure, thus it can be perfectly supported by any
off-the-shelf deep learning libraries. We formally establish filter pruning as
an optimization problem, and reveal that we need to prune filters based on
statistics information computed from its next layer, not the current layer,
which differentiates ThiNet from existing methods. Experimental results
demonstrate the effectiveness of this strategy, which has advanced the
state-of-the-art. We also show the performance of ThiNet on ILSVRC-12
benchmark. ThiNet achieves 3.31$\times$ FLOPs reduction and 16.63$\times$
compression on VGG-16, with only 0.52$\%$ top-5 accuracy drop. Similar
experiments with ResNet-50 reveal that even for a compact network, ThiNet can
also reduce more than half of the parameters and FLOPs, at the cost of roughly
1$\%$ top-5 accuracy drop. Moreover, the original VGG-16 model can be further
pruned into a very small model with only 5.05MB model size, preserving AlexNet
level accuracy but showing much stronger generalization ability.

23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
37
The categories of this paper are: supr-con
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics