Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Supervised Contrastive Replay: Revisiting the Nearest Class Mean
  Classifier in Online Class-Incremental Continual Learning   Online class-incremental continual learning (CL) studies the problem of
learning new classes continually from an online non-stationary data stream,
intending to adapt to new data while mitigating catastrophic forgetting. While
memory replay has shown promising results, the recency bias in online learning
caused by the commonly used Softmax classifier remains an unsolved challenge.
Although the Nearest-Class-Mean (NCM) classifier is significantly undervalued
in the CL community, we demonstrate that it is a simple yet effective
substitute for the Softmax classifier. It addresses the recency bias and avoids
structural changes in the fully-connected layer for new classes. Moreover, we
observe considerable and consistent performance gains when replacing the
Softmax classifier with the NCM classifier for several state-of-the-art replay
methods. To leverage the NCM classifier more effectively, data embeddings
belonging to the same class should be clustered and well-separated from those
with a different class label. To this end, we contribute Supervised Contrastive
Replay (SCR), which explicitly encourages samples from the same class to
cluster tightly in embedding space while pushing those of different classes
further apart during replay-based training. Overall, we observe that our
proposed SCR substantially reduces catastrophic forgetting and outperforms
state-of-the-art CL methods by a significant margin on a variety of datasets.

5
The categories of this paper are: gr-qc
9
The categories of this paper are: nlin
19
The categories of this paper are: eess
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol