Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Active online learning in the binary perceptron problem   The binary perceptron is the simplest artificial neural network formed by $N$
input units and one output unit, with the neural states and the synaptic
weights all restricted to $\pm 1$ values. The task in the teacher--student
scenario is to infer the hidden weight vector by training on a set of labeled
patterns. Previous efforts on the passive learning mode have shown that
learning from independent random patterns is quite inefficient. Here we
consider the active online learning mode in which the student designs every new
Ising training pattern. We demonstrate that it is mathematically possible to
achieve perfect (error-free) inference using only $N$ designed training
patterns, but this is computationally unfeasible for large systems. We then
investigate two Bayesian statistical designing protocols, which require $2.3 N$
and $1.9 N$ training patterns, respectively, to achieve error-free inference.
If the training patterns are instead designed through deductive reasoning,
perfect inference is achieved using $N\!+\!\log_{2}\!N$ samples. The
performance gap between Bayesian and deductive designing strategies may be
shortened in future work by taking into account the possibility of ergodicity
breaking in the version space of the binary perceptron.

36
The categories of this paper are: cmp-lg
16
The categories of this paper are: stat
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
11
The categories of this paper are: hep-lat
26
The categories of this paper are: bayes-an
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
20
The categories of this paper are: acc-phys
23
The categories of this paper are: solv-int
22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph