Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Analysis of the Gradient Descent Algorithm for a Deep Neural Network
  Model with Skip-connections   The behavior of the gradient descent (GD) algorithm is analyzed for a deep
neural network model with skip-connections. It is proved that in the
over-parametrized regime, for a suitable initialization, with high probability
GD can find a global minimum exponentially fast. Generalization error estimates
along the GD path are also established. As a consequence, it is shown that when
the target function is in the reproducing kernel Hilbert space (RKHS) with a
kernel defined by the initialization, there exist generalizable early-stopping
solutions along the GD path. In addition, it is also shown that the GD path is
uniformly close to the functions given by the related random feature model.
Consequently, in this "implicit regularization" setting, the deep neural
network model deteriorates to a random feature model. Our results hold for
neural networks of any width larger than the input dimension.

3
The categories of this paper are: physics
13
The categories of this paper are: quant-ph
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
11
The categories of this paper are: hep-lat
0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
35
The categories of this paper are: mtrl-th
4
The categories of this paper are: cond-mat
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an