Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Subdominant Dense Clusters Allow for Simple Learning and High
  Computational Performance in Neural Networks with Discrete Synapses   We show that discrete synaptic weights can be efficiently used for learning
in large scale neural systems, and lead to unanticipated computational
performance. We focus on the representative case of learning random patterns
with binary synapses in single layer networks. The standard statistical
analysis shows that this problem is exponentially dominated by isolated
solutions that are extremely hard to find algorithmically. Here, we introduce a
novel method that allows us to find analytical evidence for the existence of
subdominant and extremely dense regions of solutions. Numerical experiments
confirm these findings. We also show that the dense regions are surprisingly
accessible by simple learning protocols, and that these synaptic configurations
are robust to perturbations and generalize better than typical solutions. These
outcomes extend to synapses with multiple states and to deeper neural
architectures. The large deviation measure also suggests how to design novel
algorithmic schemes for optimization based on local entropy maximization.

19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
31
The categories of this paper are: ao-sci
13
The categories of this paper are: quant-ph
28
The categories of this paper are: alg-geom