Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Ternary Feature Masks: zero-forgetting for task-incremental learning   We propose an approach without any forgetting to continual learning for the
task-aware regime, where at inference the task-label is known. By using ternary
masks we can upgrade a model to new tasks, reusing knowledge from previous
tasks while not forgetting anything about them. Using masks prevents both
catastrophic forgetting and backward transfer. We argue -- and show
experimentally -- that avoiding the former largely compensates for the lack of
the latter, which is rarely observed in practice. In contrast to earlier works,
our masks are applied to the features (activations) of each layer instead of
the weights. This considerably reduces the number of mask parameters for each
new task; with more than three orders of magnitude for most networks. The
encoding of the ternary masks into two bits per feature creates very little
overhead to the network, avoiding scalability issues. To allow already learned
features to adapt to the current task without changing the behavior of these
features for previous tasks, we introduce task-specific feature normalization.
Extensive experiments on several finegrained datasets and ImageNet show that
our method outperforms current state-of-the-art while reducing memory overhead
in comparison to weight-based approaches.

33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
13
The categories of this paper are: quant-ph
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga