Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Low-Dimensional Manifolds Support Multiplexed Integrations in Recurrent
  Neural Networks   We study the learning dynamics and the representations emerging in Recurrent
Neural Networks trained to integrate one or multiple temporal signals.
Combining analytical and numerical investigations, we characterize the
conditions under which a RNN with n neurons learns to integrate D(n) scalar
signals of arbitrary duration. We show, both for linear and ReLU neurons, that
its internal state lives close to a D-dimensional manifold, whose shape is
related to the activation function. Each neuron therefore carries, to various
degrees, information about the value of all integrals. We discuss the deep
analogy between our results and the concept of mixed selectivity forged by
computational neuroscientists to interpret cortical recordings.

18
The categories of this paper are: econ
16
The categories of this paper are: stat
2
The categories of this paper are: math
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th
22
The categories of this paper are: chao-dyn
5
The categories of this paper are: gr-qc
15
The categories of this paper are: nucl-ex
12
The categories of this paper are: nucl-th
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
24
The categories of this paper are: dg-ga