Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Energy awareness in low precision neural networks   Power consumption is a major obstacle in the deployment of deep neural
networks (DNNs) on end devices. Existing approaches for reducing power
consumption rely on quite general principles, including avoidance of
multiplication operations and aggressive quantization of weights and
activations. However, these methods do not take into account the precise power
consumed by each module in the network, and are therefore not optimal. In this
paper we develop accurate power consumption models for all arithmetic
operations in the DNN, under various working conditions. We reveal several
important factors that have been overlooked to date. Based on our analysis, we
present PANN (power-aware neural network), a simple approach for approximating
any full-precision network by a low-power fixed-precision variant. Our method
can be applied to a pre-trained network, and can also be used during training
to achieve improved performance. In contrast to previous methods, PANN incurs
only a minor degradation in accuracy w.r.t. the full-precision version of the
network, even when working at the power-budget of a 2-bit quantized variant. In
addition, our scheme enables to seamlessly traverse the power-accuracy
trade-off at deployment time, which is a major advantage over existing
quantization methods that are constrained to specific bit widths.

34
The categories of this paper are: chem-ph
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
32
The categories of this paper are: atom-ph
20
The categories of this paper are: acc-phys
24
The categories of this paper are: dg-ga
13
The categories of this paper are: quant-ph
2
The categories of this paper are: math
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
12
The categories of this paper are: nucl-th