Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Selective Output Smoothing Regularization: Regularize Neural Networks by
  Softening Output Distributions   In this paper, we propose Selective Output Smoothing Regularization, a novel
regularization method for training the Convolutional Neural Networks (CNNs).
Inspired by the diverse effects on training from different samples, Selective
Output Smoothing Regularization improves the performance by encouraging the
model to produce equal logits on incorrect classes when dealing with samples
that the model classifies correctly and over-confidently. This plug-and-play
regularization method can be conveniently incorporated into almost any
CNN-based project without extra hassle. Extensive experiments have shown that
Selective Output Smoothing Regularization consistently achieves significant
improvement in image classification benchmarks, such as CIFAR-100, Tiny
ImageNet, ImageNet, and CUB-200-2011. Particularly, our method obtains 77.30%
accuracy on ImageNet with ResNet-50, which gains 1.1% than baseline (76.2%). We
also empirically demonstrate the ability of our method to make further
improvements when combining with other widely used regularization techniques.
On Pascal detection, using the SOSR-trained ImageNet classifier as the
pretrained model leads to better detection performances.

8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
3
The categories of this paper are: physics
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex