Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Neural Network Gaussian Processes by Increasing Depth   Recent years have witnessed an increasing interest in the correspondence
between infinitely wide networks and Gaussian processes. Despite the
effectiveness and elegance of the current neural network Gaussian process
theory, to the best of our knowledge, all the neural network Gaussian processes
are essentially induced by increasing width. However, in the era of deep
learning, what concerns us more regarding a neural network is its depth as well
as how depth impacts the behaviors of a network. Inspired by a width-depth
symmetry consideration, we use a shortcut network to show that increasing the
depth of a neural network can also give rise to a Gaussian process, which is a
valuable addition to the existing theory and contributes to revealing the true
picture of deep learning. Beyond the proposed Gaussian process by depth, we
theoretically characterize its uniform tightness property and the smallest
eigenvalue of its associated kernel. These characterizations can not only
enhance our understanding of the proposed depth-induced Gaussian processes but
also pave the way for future applications. Lastly, we examine the performance
of the proposed Gaussian process by regression experiments on two real-world
data sets.

24
The categories of this paper are: dg-ga
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
16
The categories of this paper are: stat
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
8
The categories of this paper are: hep-ex
0
The categories of this paper are: hep-ph
20
The categories of this paper are: acc-phys