Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A continual learning survey: Defying forgetting in classification tasks   Artificial neural networks thrive in solving the classification problem for a
particular rigid task, acquiring knowledge through generalized learning
behaviour from a distinct training phase. The resulting network resembles a
static entity of knowledge, with endeavours to extend this knowledge without
targeting the original task resulting in a catastrophic forgetting. Continual
learning shifts this paradigm towards networks that can continually accumulate
knowledge over different tasks without the need to retrain from scratch. We
focus on task incremental classification, where tasks arrive sequentially and
are delineated by clear boundaries. Our main contributions concern 1) a
taxonomy and extensive overview of the state-of-the-art, 2) a novel framework
to continually determine the stability-plasticity trade-off of the continual
learner, 3) a comprehensive experimental comparison of 11 state-of-the-art
continual learning methods and 4 baselines. We empirically scrutinize method
strengths and weaknesses on three benchmarks, considering Tiny Imagenet and
large-scale unbalanced iNaturalist and a sequence of recognition datasets. We
study the influence of model capacity, weight decay and dropout regularization,
and the order in which the tasks are presented, and qualitatively compare
methods in terms of required memory, computation time, and storage.

7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
29
The categories of this paper are: funct-an
30
The categories of this paper are: q-alg