Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Data-Driven Sparse Structure Selection for Deep Neural Networks   Deep convolutional neural networks have liberated its extraordinary power on
various tasks. However, it is still very challenging to deploy state-of-the-art
models into real-world applications due to their high computational complexity.
How can we design a compact and effective network without massive experiments
and expert knowledge? In this paper, we propose a simple and effective
framework to learn and prune deep models in an end-to-end manner. In our
framework, a new type of parameter -- scaling factor is first introduced to
scale the outputs of specific structures, such as neurons, groups or residual
blocks. Then we add sparsity regularizations on these factors, and solve this
optimization problem by a modified stochastic Accelerated Proximal Gradient
(APG) method. By forcing some of the factors to zero, we can safely remove the
corresponding structures, thus prune the unimportant parts of a CNN. Comparing
with other structure selection methods that may need thousands of trials or
iterative fine-tuning, our method is trained fully end-to-end in one training
pass without bells and whistles. We evaluate our method, Sparse Structure
Selection with several state-of-the-art CNNs, and demonstrate very promising
results with adaptive depth and width selection.

10
The categories of this paper are: q-bio
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
33
The categories of this paper are: plasm-ph
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
24
The categories of this paper are: dg-ga
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
28
The categories of this paper are: alg-geom