Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Bimodal Distributed Binarized Neural Networks   Binary Neural Networks (BNNs) are an extremely promising method to reduce
deep neural networks' complexity and power consumption massively. Binarization
techniques, however, suffer from ineligible performance degradation compared to
their full-precision counterparts.
  Prior work mainly focused on strategies for sign function approximation
during forward and backward phases to reduce the quantization error during the
binarization process. In this work, we propose a Bi-Modal Distributed
binarization method (\methodname{}). That imposes bi-modal distribution of the
network weights by kurtosis regularization. The proposed method consists of a
training scheme that we call Weight Distribution Mimicking (WDM), which
efficiently imitates the full-precision network weight distribution to their
binary counterpart. Preserving this distribution during binarization-aware
training creates robust and informative binary feature maps and significantly
reduces the generalization error of the BNN. Extensive evaluations on CIFAR-10
and ImageNet demonstrate the superiority of our method over current
state-of-the-art schemes. Our source code, experimental settings, training
logs, and binary models are available at
\url{https://github.com/BlueAnon/BD-BNN}.

9
The categories of this paper are: nlin
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph