Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Compressing Convolutional Neural Networks   Convolutional neural networks (CNN) are increasingly used in many areas of
computer vision. They are particularly attractive because of their ability to
"absorb" great quantities of labeled data through millions of parameters.
However, as model sizes increase, so do the storage and memory requirements of
the classifiers. We present a novel network architecture, Frequency-Sensitive
Hashed Nets (FreshNets), which exploits inherent redundancy in both
convolutional layers and fully-connected layers of a deep learning model,
leading to dramatic savings in memory and storage consumption. Based on the key
observation that the weights of learned convolutional filters are typically
smooth and low-frequency, we first convert filter weights to the frequency
domain with a discrete cosine transform (DCT) and use a low-cost hash function
to randomly group frequency parameters into hash buckets. All parameters
assigned the same hash bucket share a single value learned with standard
back-propagation. To further reduce model size we allocate fewer hash buckets
to high-frequency components, which are generally less important. We evaluate
FreshNets on eight data sets, and show that it leads to drastically better
compressed performance than several relevant baselines.

8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
17
The categories of this paper are: q-fin
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
4
The categories of this paper are: cond-mat
0
The categories of this paper are: hep-ph
16
The categories of this paper are: stat
6
The categories of this paper are: astro-ph
28
The categories of this paper are: alg-geom