Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Continual Learning of Multi-modal Dynamics with External Memory   We study the problem of fitting a model to a dynamical environment when new
modes of behavior emerge sequentially. The learning model is aware when a new
mode appears, but it does not have access to the true modes of individual
training sequences. We devise a novel continual learning method that maintains
a descriptor of the mode of an encountered sequence in a neural episodic
memory. We employ a Dirichlet Process prior on the attention weights of the
memory to foster efficient storage of the mode descriptors. Our method performs
continual learning by transferring knowledge across tasks by retrieving the
descriptors of similar modes of past tasks to the mode of a current sequence
and feeding this descriptor into its transition kernel as control input. We
observe the continual learning performance of our method to compare favorably
to the mainstream parameter transfer approach.

22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
33
The categories of this paper are: plasm-ph
23
The categories of this paper are: solv-int
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio