Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Neural Tangent Kernel Analysis of Deep Narrow Neural Networks   The tremendous recent progress in analyzing the training dynamics of
overparameterized neural networks has primarily focused on wide networks and
therefore does not sufficiently address the role of depth in deep learning. In
this work, we present the first trainability guarantee of infinitely deep but
narrow neural networks. We study the infinite-depth limit of a multilayer
perceptron (MLP) with a specific initialization and establish a trainability
guarantee using the NTK theory. We then extend the analysis to an infinitely
deep convolutional neural network (CNN) and perform brief experiments

34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
36
The categories of this paper are: cmp-lg
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
31
The categories of this paper are: ao-sci
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
5
The categories of this paper are: gr-qc