Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Spline parameterization of neural network controls for deep learning   Based on the continuous interpretation of deep learning cast as an optimal
control problem, this paper investigates the benefits of employing B-spline
basis functions to parameterize neural network controls across the layers.
Rather than equipping each layer of a discretized ODE-network with a set of
trainable weights, we choose a fixed number of B-spline basis functions whose
coefficients are the trainable parameters of the neural network. Decoupling the
trainable parameters from the layers of the neural network enables us to
investigate and adapt the accuracy of the network propagation separated from
the optimization learning problem. We numerically show that the spline-based
neural network increases robustness of the learning problem towards
hyperparameters due to increased stability and accuracy of the network
propagation. Further, training on B-spline coefficients rather than layer
weights directly enables a reduction in the number of trainable parameters.

29
The categories of this paper are: funct-an
7
The categories of this paper are: hep-th
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
2
The categories of this paper are: math
3
The categories of this paper are: physics
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
30
The categories of this paper are: q-alg
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
4
The categories of this paper are: cond-mat
16
The categories of this paper are: stat
5
The categories of this paper are: gr-qc
19
The categories of this paper are: eess
8
The categories of this paper are: hep-ex