Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning and Generalization in RNNs   Simple recurrent neural networks (RNNs) and their more advanced cousins LSTMs
etc. have been very successful in sequence modeling. Their theoretical
understanding, however, is lacking and has not kept pace with the progress for
feedforward networks, where a reasonably complete understanding in the special
case of highly overparametrized one-hidden-layer networks has emerged. In this
paper, we make progress towards remedying this situation by proving that RNNs
can learn functions of sequences. In contrast to the previous work that could
only deal with functions of sequences that are sums of functions of individual
tokens in the sequence, we allow general functions. Conceptually and
technically, we introduce new ideas which enable us to extract information from
the hidden state of the RNN in our proofs -- addressing a crucial weakness in
previous work. We illustrate our results on some regular language recognition
problems.

4
The categories of this paper are: cond-mat
7
The categories of this paper are: hep-th
19
The categories of this paper are: eess
22
The categories of this paper are: chao-dyn
16
The categories of this paper are: stat
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
18
The categories of this paper are: econ
14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
26
The categories of this paper are: bayes-an
20
The categories of this paper are: acc-phys
34
The categories of this paper are: chem-ph