Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modular-Relatedness for Continual Learning   In this paper, we propose a continual learning (CL) technique that is
beneficial to sequential task learners by improving their retained accuracy and
reducing catastrophic forgetting. The principal target of our approach is the
automatic extraction of modular parts of the neural network and then estimating
the relatedness between the tasks given these modular components. This
technique is applicable to different families of CL methods such as
regularization-based (e.g., the Elastic Weight Consolidation) or the
rehearsal-based (e.g., the Gradient Episodic Memory) approaches where episodic
memory is needed. Empirical results demonstrate remarkable performance gain (in
terms of robustness to forgetting) for methods such as EWC and GEM based on our
technique, especially when the memory budget is very limited.

24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
25
The categories of this paper are: patt-sol
2
The categories of this paper are: math
11
The categories of this paper are: hep-lat
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int