Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Incremental False Negative Detection for Contrastive Learning   Self-supervised learning has recently shown great potential in vision tasks
through contrastive learning, which aims to discriminate each image, or
instance, in the dataset. However, such instance-level learning ignores the
semantic relationship among instances and sometimes undesirably repels the
anchor from the semantically similar samples, termed as "false negatives". In
this work, we show that the unfavorable effect from false negatives is more
significant for the large-scale datasets with more semantic concepts. To
address the issue, we propose a novel self-supervised contrastive learning
framework that incrementally detects and explicitly removes the false negative
samples. Specifically, following the training process, our method dynamically
detects increasing high-quality false negatives considering that the encoder
gradually improves and the embedding space becomes more semantically
structural. Next, we discuss two strategies to explicitly remove the detected
false negatives during contrastive learning. Extensive experiments show that
our framework outperforms other self-supervised contrastive learning methods on
multiple benchmarks in a limited resource setup.

35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
4
The categories of this paper are: cond-mat
3
The categories of this paper are: physics
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph
27
The categories of this paper are: comp-gas
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol