Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adaptive Learning Rule for Hardware-based Deep Neural Networks Using
  Electronic Synapse Devices   In this paper, we propose a learning rule based on a back-propagation (BP)
algorithm that can be applied to a hardware-based deep neural network (HW-DNN)
using electronic devices that exhibit discrete and limited conductance
characteristics. This adaptive learning rule, which enables forward, backward
propagation, as well as weight updates in hardware, is helpful during the
implementation of power-efficient and high-speed deep neural networks. In
simulations using a three-layer perceptron network, we evaluate the learning
performance according to various conductance responses of electronic synapse
devices and weight-updating methods. It is shown that the learning accuracy is
comparable to that obtained when using a software-based BP algorithm when the
electronic synapse device has a linear conductance response with a high dynamic
range. Furthermore, the proposed unidirectional weight-updating method is
suitable for electronic synapse devices which have nonlinear and finite
conductance responses. Because this weight-updating method can compensate the
demerit of asymmetric weight updates, we can obtain better accuracy compared to
other methods. This adaptive learning rule, which can be applied to full
hardware implementation, can also compensate the degradation of learning
accuracy due to the probable device-to-device variation in an actual electronic
synapse device.

5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
17
The categories of this paper are: q-fin
16
The categories of this paper are: stat
20
The categories of this paper are: acc-phys
33
The categories of this paper are: plasm-ph
19
The categories of this paper are: eess
25
The categories of this paper are: patt-sol
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph