Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Explicit regularization and implicit bias in deep network classifiers
  trained with the square loss   Deep ReLU networks trained with the square loss have been observed to perform
well in classification tasks. We provide here a theoretical justification based
on analysis of the associated gradient flow. We show that convergence to a
solution with the absolute minimum norm is expected when normalization
techniques such as Batch Normalization (BN) or Weight Normalization (WN) are
used together with Weight Decay (WD). The main property of the minimizers that
bounds their expected error is the norm: we prove that among all the
close-to-interpolating solutions, the ones associated with smaller Frobenius
norms of the unnormalized weight matrices have better margin and better bounds
on the expected classification error. With BN but in the absence of WD, the
dynamical system is singular. Implicit dynamical regularization -- that is
zero-initial conditions biasing the dynamics towards high margin solutions --
is also possible in the no-BN and no-WD case. The theory yields several
predictions, including the role of BN and weight decay, aspects of Papyan, Han
and Donoho's Neural Collapse and the constraints induced by BN on the network
weights.

4
The categories of this paper are: cond-mat
8
The categories of this paper are: hep-ex
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
36
The categories of this paper are: cmp-lg
32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
9
The categories of this paper are: nlin
12
The categories of this paper are: nucl-th
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
2
The categories of this paper are: math