Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cross-Channel Intragroup Sparsity Neural Network   Modern deep neural networks rely on overparameterization to achieve
state-of-the-art generalization. But overparameterized models are
computationally expensive. Network pruning is often employed to obtain less
demanding models for deployment. Fine-grained pruning removes individual
weights in parameter tensors and can achieve a high model compression ratio
with little accuracy degradation. However, it introduces irregularity into the
computing dataflow and often does not yield improved model inference efficiency
in practice. Coarse-grained model pruning, while realizing satisfactory
inference speedup through removal of network weights in groups, e.g. an entire
filter, often lead to significant accuracy degradation. This work introduces
the cross-channel intragroup (CCI) sparsity structure, which can prevent the
inference inefficiency of fine-grained pruning while maintaining outstanding
model performance. We then present a novel training algorithm designed to
perform well under the constraint imposed by the CCI-Sparsity. Through a series
of comparative experiments we show that our proposed CCI-Sparsity structure and
the corresponding pruning algorithm outperform prior art in inference
efficiency by a substantial margin given suited hardware acceleration in the
future.

36
The categories of this paper are: cmp-lg
14
The categories of this paper are: math-ph
29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics