Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learn Continually, Generalize Rapidly: Lifelong Knowledge Accumulation
  for Few-shot Learning   The ability to continuously expand knowledge over time and utilize it to
rapidly generalize to new tasks is a key feature of human linguistic
intelligence. Existing models that pursue rapid generalization to new tasks
(e.g., few-shot learning methods), however, are mostly trained in a single shot
on fixed datasets, unable to dynamically expand their knowledge; while
continual learning algorithms are not specifically designed for rapid
generalization. We present a new learning setup, Continual Learning of Few-Shot
Learners (CLIF), to address the challenges of both learning settings in a
unified setup. CLIF assumes a model learns from a sequence of diverse NLP tasks
arriving sequentially, accumulating knowledge for improved generalization to
new tasks, while also retaining performance on the tasks learned earlier. We
examine how the generalization ability is affected in the continual learning
setup, evaluate a number of continual learning algorithms, and propose a novel
regularized adapter generation approach. We find that catastrophic forgetting
affects generalization ability to a less degree than performance on seen tasks;
while continual learning algorithms can still bring considerable benefit to the
generalization ability.

21
The categories of this paper are: adap-org
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
22
The categories of this paper are: chao-dyn
27
The categories of this paper are: comp-gas
19
The categories of this paper are: eess
30
The categories of this paper are: q-alg
10
The categories of this paper are: q-bio
5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int