Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Sequential mastery of multiple visual tasks: Networks naturally learn to
  learn and forget to forget   We explore the behavior of a standard convolutional neural net in a
continual-learning setting that introduces visual classification tasks
sequentially and requires the net to master new tasks while preserving mastery
of previously learned tasks. This setting corresponds to that which human
learners face as they acquire domain expertise serially, for example, as an
individual studies a textbook. Through simulations involving sequences of ten
related visual tasks, we find reason for optimism that nets will scale well as
they advance from having a single skill to becoming multi-skill domain experts.
We observe two key phenomena. First, \emph{forward facilitation}---the
accelerated learning of task $n+1$ having learned $n$ previous tasks---grows
with $n$. Second, \emph{backward interference}---the forgetting of the $n$
previous tasks when learning task $n+1$---diminishes with $n$. Amplifying
forward facilitation is the goal of research on metalearning, and attenuating
backward interference is the goal of research on catastrophic forgetting. We
find that both of these goals are attained simply through broader exposure to a
domain.

22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
2
The categories of this paper are: math
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio