Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Few-Shot Self Reminder to Overcome Catastrophic Forgetting   Deep neural networks are known to suffer the catastrophic forgetting problem,
where they tend to forget the knowledge from the previous tasks when
sequentially learning new tasks. Such failure hinders the application of deep
learning based vision system in continual learning settings. In this work, we
present a simple yet surprisingly effective way of preventing catastrophic
forgetting. Our method, called Few-shot Self Reminder (FSR), regularizes the
neural net from changing its learned behaviour by performing logit matching on
selected samples kept in episodic memory from the old tasks. Surprisingly, this
simplistic approach only requires to retrain a small amount of data in order to
outperform previous methods in knowledge retention. We demonstrate the
superiority of our method to the previous ones in two different continual
learning settings on popular benchmarks, as well as a new continual learning
problem where tasks are designed to be more dissimilar.

36
The categories of this paper are: cmp-lg
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc
12
The categories of this paper are: nucl-th
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
27
The categories of this paper are: comp-gas