Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Fighting Quantization Bias With Bias   Low-precision representation of deep neural networks (DNNs) is critical for
efficient deployment of deep learning application on embedded platforms,
however, converting the network to low precision degrades its performance.
Crucially, networks that are designed for embedded applications usually suffer
from increased degradation since they have less redundancy. This is most
evident for the ubiquitous MobileNet architecture which requires a costly
quantization-aware training cycle to achieve acceptable performance when
quantized to 8-bits. In this paper, we trace the source of the degradation in
MobileNets to a shift in the mean activation value. This shift is caused by an
inherent bias in the quantization process which builds up across layers,
shifting all network statistics away from the learned distribution. We show
that this phenomenon happens in other architectures as well. We propose a
simple remedy - compensating for the quantization induced shift by adding a
constant to the additive bias term of each channel. We develop two simple
methods for estimating the correction constants - one using iterative
evaluation of the quantized network and one where the constants are set using a
short training phase. Both methods are fast and require only a small amount of
unlabeled data, making them appealing for rapid deployment of neural networks.
Using the above methods we are able to match the performance of training-based
quantization of MobileNets at a fraction of the cost.

9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
19
The categories of this paper are: eess
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
28
The categories of this paper are: alg-geom
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys