Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: The Dynamics of Gradient Descent for Overparametrized Neural Networks   We consider the dynamics of gradient descent (GD) in overparameterized single
hidden layer neural networks with a squared loss function. Recently, it has
been shown that, under some conditions, the parameter values obtained using GD
achieve zero training error and generalize well if the initial conditions are
chosen appropriately. Here, through a Lyapunov analysis, we show that the
dynamics of neural network weights under GD converge to a point which is close
to the minimum norm solution subject to the condition that there is no training
error when using the linear approximation to the neural network. To illustrate
the application of this result, we show that the GD converges to a prediction
function that generalizes well, thereby providing an alternative proof of the
generalization results in Arora et al. (2019).

25
The categories of this paper are: patt-sol
5
The categories of this paper are: gr-qc
18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
28
The categories of this paper are: alg-geom
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex