Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: SYMOG: learning symmetric mixture of Gaussian modes for improved
  fixed-point quantization   Deep neural networks (DNNs) have been proven to outperform classical methods
on several machine learning benchmarks. However, they have high computational
complexity and require powerful processing units. Especially when deployed on
embedded systems, model size and inference time must be significantly reduced.
We propose SYMOG (symmetric mixture of Gaussian modes), which significantly
decreases the complexity of DNNs through low-bit fixed-point quantization.
SYMOG is a novel soft quantization method such that the learning task and the
quantization are solved simultaneously. During training the weight distribution
changes from an unimodal Gaussian distribution to a symmetric mixture of
Gaussians, where each mean value belongs to a particular fixed-point mode. We
evaluate our approach with different architectures (LeNet5, VGG7, VGG11,
DenseNet) on common benchmark data sets (MNIST, CIFAR-10, CIFAR-100) and we
compare with state-of-the-art quantization approaches. We achieve excellent
results and outperform 2-bit state-of-the-art performance with an error rate of
only 5.71% on CIFAR-10 and 27.65% on CIFAR-100.

35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat
31
The categories of this paper are: ao-sci
5
The categories of this paper are: gr-qc