Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Knowledge Capture and Replay for Continual Learning   Deep neural networks have shown promise in several domains, and the learned
data (task) specific information is implicitly stored in the network
parameters. Extraction and utilization of encoded knowledge representations are
vital when data is no longer available in the future, especially in a continual
learning scenario. In this work, we introduce {\em flashcards}, which are
visual representations that {\em capture} the encoded knowledge of a network as
a recursive function of predefined random image patterns. In a continual
learning scenario, flashcards help to prevent catastrophic forgetting and
consolidating knowledge of all the previous tasks. Flashcards need to be
constructed only before learning the subsequent task, and hence, independent of
the number of tasks trained before. We demonstrate the efficacy of flashcards
in capturing learned knowledge representation (as an alternative to the
original dataset) and empirically validate on a variety of continual learning
tasks: reconstruction, denoising, task-incremental learning, and new-instance
learning classification, using several heterogeneous benchmark datasets.
Experimental evidence indicates that: (i) flashcards as a replay strategy is {
\em task agnostic}, (ii) performs better than generative replay, and (iii) is
on par with episodic replay without additional memory overhead.

24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
4
The categories of this paper are: cond-mat