Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Positive-Congruent Training: Towards Regression-Free Model Updates   Reducing inconsistencies in the behavior of different versions of an AI
system can be as important in practice as reducing its overall error. In image
classification, sample-wise inconsistencies appear as "negative flips": A new
model incorrectly predicts the output for a test sample that was correctly
classified by the old (reference) model. Positive-congruent (PC) training aims
at reducing error rate while at the same time reducing negative flips, thus
maximizing congruency with the reference model only on positive predictions,
unlike model distillation. We propose a simple approach for PC training, Focal
Distillation, which enforces congruence with the reference model by giving more
weights to samples that were correctly classified. We also found that, if the
reference model itself can be chosen as an ensemble of multiple deep neural
networks, negative flips can be further reduced without affecting the new
model's accuracy.

4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
25
The categories of this paper are: patt-sol
6
The categories of this paper are: astro-ph
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
37
The categories of this paper are: supr-con
16
The categories of this paper are: stat
19
The categories of this paper are: eess
21
The categories of this paper are: adap-org
20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
3
The categories of this paper are: physics
2
The categories of this paper are: math