Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Distribution Mismatch Correction for Improved Robustness in Deep Neural
  Networks   Deep neural networks rely heavily on normalization methods to improve their
performance and learning behavior. Although normalization methods spurred the
development of increasingly deep and efficient architectures, they also
increase the vulnerability with respect to noise and input corruptions. In most
applications, however, noise is ubiquitous and diverse; this can often lead to
complete failure of machine learning systems as they fail to cope with
mismatches between the input distribution during training- and test-time. The
most common normalization method, batch normalization, reduces the distribution
shift during training but is agnostic to changes in the input distribution
during test time. This makes batch normalization prone to performance
degradation whenever noise is present during test-time. Sample-based
normalization methods can correct linear transformations of the activation
distribution but cannot mitigate changes in the distribution shape; this makes
the network vulnerable to distribution changes that cannot be reflected in the
normalization parameters. We propose an unsupervised non-parametric
distribution correction method that adapts the activation distribution of each
layer. This reduces the mismatch between the training and test-time
distribution by minimizing the 1-D Wasserstein distance. In our experiments, we
empirically show that the proposed method effectively reduces the impact of
intense image corruptions and thus improves the classification performance
without the need for retraining or fine-tuning the model.

17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn