Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Manifold Regularized Dynamic Network Pruning   Neural network pruning is an essential approach for reducing the
computational complexity of deep models so that they can be well deployed on
resource-limited devices. Compared with conventional methods, the recently
developed dynamic pruning methods determine redundant filters variant to each
input instance which achieves higher acceleration. Most of the existing methods
discover effective sub-networks for each instance independently and do not
utilize the relationship between different inputs. To maximally excavate
redundancy in the given network architecture, this paper proposes a new
paradigm that dynamically removes redundant filters by embedding the manifold
information of all instances into the space of pruned networks (dubbed as
ManiDP). We first investigate the recognition complexity and feature similarity
between images in the training set. Then, the manifold relationship between
instances and the pruned sub-networks will be aligned in the training
procedure. The effectiveness of the proposed method is verified on several
benchmarks, which shows better performance in terms of both accuracy and
computational cost compared to the state-of-the-art methods. For example, our
method can reduce 55.3% FLOPs of ResNet-34 with only 0.57% top-1 accuracy
degradation on ImageNet.

24
The categories of this paper are: dg-ga
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
6
The categories of this paper are: astro-ph
8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
21
The categories of this paper are: adap-org
27
The categories of this paper are: comp-gas
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th