Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Exploiting Weight Redundancy in CNNs: Beyond Pruning and Quantization   Pruning and quantization are proven methods for improving the performance and
storage efficiency of convolutional neural networks (CNNs). Pruning removes
near-zero weights in tensors and masks weak connections between neurons in
neighbouring layers. Quantization reduces the precision of weights by replacing
them with numerically similar values that require less storage. In this paper,
we identify another form of redundancy in CNN weight tensors, in the form of
repeated patterns of similar values. We observe that pruning and quantization
both tend to drastically increase the number of repeated patterns in the weight
tensors.
  We investigate several compression schemes to take advantage of this
structure in CNN weight data, including multiple forms of Huffman coding, and
other approaches inspired by block sparse matrix formats. We evaluate our
approach on several well-known CNNs and find that we can achieve compaction
ratios of 1.4x to 3.1x in addition to the saving from pruning and quantization.

34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
4
The categories of this paper are: cond-mat
5
The categories of this paper are: gr-qc
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
37
The categories of this paper are: supr-con
19
The categories of this paper are: eess
6
The categories of this paper are: astro-ph
25
The categories of this paper are: patt-sol
0
The categories of this paper are: hep-ph
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex