Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Standard Deviation-Based Quantization for Deep Neural Networks   Quantization of deep neural networks is a promising approach that reduces the
inference cost, making it feasible to run deep networks on resource-restricted
devices. Inspired by existing methods, we propose a new framework to learn the
quantization intervals (discrete values) using the knowledge of the network's
weight and activation distributions, i.e., standard deviation. Furthermore, we
propose a novel base-2 logarithmic quantization scheme to quantize weights to
power-of-two discrete values. Our proposed scheme allows us to replace
resource-hungry high-precision multipliers with simple shift-add operations.
According to our evaluations, our method outperforms existing work on CIFAR10
and ImageNet datasets and even achieves better accuracy performance with 3-bit
weights and activations when compared to the full-precision models. Moreover,
our scheme simultaneously prunes the network's parameters and allows us to
flexibly adjust the pruning ratio during the quantization process.

37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
26
The categories of this paper are: bayes-an
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
2
The categories of this paper are: math
7
The categories of this paper are: hep-th