Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Channel-wise pruning of neural networks with tapering resource
  constraint   Neural network pruning is an important step in design process of efficient
neural networks for edge devices with limited computational power. Pruning is a
form of knowledge transfer from the weights of the original network to a
smaller target subnetwork. We propose a new method for compute-constrained
structured channel-wise pruning of convolutional neural networks. The method
iteratively fine-tunes the network, while gradually tapering the computation
resources available to the pruned network via a holonomic constraint in the
method of Lagrangian multipliers framework. An explicit and adaptive automatic
control over the rate of tapering is provided. The trainable parameters of our
pruning method are separate from the weights of the neural network, which
allows us to avoid the interference with the neural network solver (e.g. avoid
the direct dependence of pruning speed on neural network learning rates). Our
method combines the `rigoristic' approach by the direct application of
constrained optimization, avoiding the pitfalls of ADMM-based methods, like
their need to define the target amount of resources for each pruning run, and
direct dependence of pruning speed and priority of pruning on the relative
scale of weights between layers. For VGG-16 @ ILSVRC-2012, we achieve reduction
of 15.47 -> 3.87 GMAC with only 1% top-1 accuracy reduction (68.4% -> 67.4%).
For AlexNet @ ILSVRC-2012, we achieve 0.724 -> 0.411 GMAC with 1% top-1
accuracy reduction (56.8% -> 55.8%).

19
The categories of this paper are: eess
29
The categories of this paper are: funct-an
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
37
The categories of this paper are: supr-con
14
The categories of this paper are: math-ph
35
The categories of this paper are: mtrl-th
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom