Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Structural Pruning in Deep Neural Networks: A Small-World Approach   Deep Neural Networks (DNNs) are usually over-parameterized, causing excessive
memory and interconnection cost on the hardware platform. Existing pruning
approaches remove secondary parameters at the end of training to reduce the
model size; but without exploiting the intrinsic network property, they still
require the full interconnection to prepare the network. Inspired by the
observation that brain networks follow the Small-World model, we propose a
novel structural pruning scheme, which includes (1) hierarchically trimming the
network into a Small-World model before training, (2) training the network for
a given dataset, and (3) optimizing the network for accuracy. The new scheme
effectively reduces both the model size and the interconnection needed before
training, achieving a locally clustered and globally sparse model. We
demonstrate our approach on LeNet-5 for MNIST and VGG-16 for CIFAR-10,
decreasing the number of parameters to 2.3% and 9.02% of the baseline model,
respectively.

37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
23
The categories of this paper are: solv-int
24
The categories of this paper are: dg-ga
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an