Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: 'Place-cell' emergence and learning of invariant data with restricted
  Boltzmann machines: breaking and dynamical restoration of continuous
  symmetries in the weight space   Distributions of data or sensory stimuli often enjoy underlying invariances.
How and to what extent those symmetries are captured by unsupervised learning
methods is a relevant question in machine learning and in computational
neuroscience. We study here, through a combination of numerical and analytical
tools, the learning dynamics of Restricted Boltzmann Machines (RBM), a neural
network paradigm for representation learning. As learning proceeds from a
random configuration of the network weights, we show the existence of, and
characterize a symmetry-breaking phenomenon, in which the latent variables
acquire receptive fields focusing on limited parts of the invariant manifold
supporting the data. The symmetry is restored at large learning times through
the diffusion of the receptive field over the invariant manifold; hence, the
RBM effectively spans a continuous attractor in the space of network weights.
This symmetry-breaking phenomenon takes place only if the amount of data
available for training exceeds some critical value, depending on the network
size and the intensity of symmetry-induced correlations in the data; below this
'retarded-learning' threshold, the network weights are essentially noisy and
overfit the data.

19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
29
The categories of this paper are: funct-an
13
The categories of this paper are: quant-ph
28
The categories of this paper are: alg-geom
27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
7
The categories of this paper are: hep-th
2
The categories of this paper are: math
5
The categories of this paper are: gr-qc
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th