Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Feature Generalizability with Multitask Learning in Class
  Incremental Learning   Many deep learning applications, like keyword spotting, require the
incorporation of new concepts (classes) over time, referred to as Class
Incremental Learning (CIL). The major challenge in CIL is catastrophic
forgetting, i.e., preserving as much of the old knowledge as possible while
learning new tasks. Various techniques, such as regularization, knowledge
distillation, and the use of exemplars, have been proposed to resolve this
issue. However, prior works primarily focus on the incremental learning step,
while ignoring the optimization during the base model training. We hypothesize
that a more transferable and generalizable feature representation from the base
model would be beneficial to incremental learning.
  In this work, we adopt multitask learning during base model training to
improve the feature generalizability. Specifically, instead of training a
single model with all the base classes, we decompose the base classes into
multiple subsets and regard each of them as a task. These tasks are trained
concurrently and a shared feature extractor is obtained for incremental
learning. We evaluate our approach on two datasets under various
configurations. The results show that our approach enhances the average
incremental learning accuracy by up to 5.5%, which enables more reliable and
accurate keyword spotting over time. Moreover, the proposed approach can be
combined with many existing techniques and provides additional performance
gain.

12
The categories of this paper are: nucl-th
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
32
The categories of this paper are: atom-ph
15
The categories of this paper are: nucl-ex
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg