Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Meta Learning Backpropagation And Improving It   Many concepts have been proposed for meta learning with neural networks
(NNs), e.g., NNs that learn to reprogram fast weights, Hebbian plasticity,
learned learning rules, and meta recurrent NNs. Our Variable Shared Meta
Learning (VSML) unifies the above and demonstrates that simple weight-sharing
and sparsity in an NN is sufficient to express powerful learning algorithms
(LAs) in a reusable fashion. A simple implementation of VSML where the weights
of a neural network are replaced by tiny LSTMs allows for implementing the
backpropagation LA solely by running in forward-mode. It can even meta learn
new LAs that differ from online backpropagation and generalize to datasets
outside of the meta training distribution without explicit gradient
calculation. Introspection reveals that our meta learned LAs learn through fast
association in a way that is qualitatively different from gradient descent.

33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
6
The categories of this paper are: astro-ph
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
8
The categories of this paper are: hep-ex
24
The categories of this paper are: dg-ga
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
10
The categories of this paper are: q-bio
18
The categories of this paper are: econ
19
The categories of this paper are: eess