Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: State Space Representations of Deep Neural Networks   This paper deals with neural networks as dynamical systems governed by
differential or difference equations. It shows that the introduction of skip
connections into network architectures, such as residual networks and dense
networks, turns a system of static equations into a system of dynamical
equations with varying levels of smoothness on the layer-wise transformations.
Closed form solutions for the state space representations of general dense
networks, as well as $k^{th}$ order smooth networks, are found in general
settings. Furthermore, it is shown that imposing $k^{th}$ order smoothness on a
network architecture with $d$-many nodes per layer increases the state space
dimension by a multiple of $k$, and so the effective embedding dimension of the
data manifold is $k \cdot d$-many dimensions. It follows that network
architectures of these types reduce the number of parameters needed to maintain
the same embedding dimension by a factor of $k^2$ when compared to an
equivalent first-order, residual network, significantly motivating the
development of network architectures of these types. Numerical simulations were
run to validate parts of the developed theory.

37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
35
The categories of this paper are: mtrl-th
32
The categories of this paper are: atom-ph
23
The categories of this paper are: solv-int
7
The categories of this paper are: hep-th
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
33
The categories of this paper are: plasm-ph