Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Improving Generalization of Deep Neural Networks by Leveraging Margin
  Distribution   Recent research has used margin theory to analyze the generalization
performance for deep neural networks (DNNs). The existed results are almost
based on the spectrally-normalized minimum margin. However, optimizing the
minimum margin ignores a mass of information about the entire margin
distribution, which is crucial to generalization performance. In this paper, we
prove a generalization upper bound dominated by the statistics of the entire
margin distribution. Compared with the minimum margin bounds, our bound
highlights an important measure for controlling the complexity, which is the
ratio of the margin standard deviation to the expected margin. We utilize a
convex margin distribution loss function on the deep neural networks to
validate our theoretical results by optimizing the margin ratio. Experiments
and visualizations confirm the effectiveness of our approach and the
correlation between generalization gap and margin ratio.

25
The categories of this paper are: patt-sol
29
The categories of this paper are: funct-an
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org