Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Stable Tensor Neural Networks for Rapid Deep Learning   We propose a tensor neural network ($t$-NN) framework that offers an exciting
new paradigm for designing neural networks with multidimensional (tensor) data.
Our network architecture is based on the $t$-product (Kilmer and Martin, 2011),
an algebraic formulation to multiply tensors via circulant convolution. In this
$t$-product algebra, we interpret tensors as $t$-linear operators analogous to
matrices as linear operators, and hence our framework inherits mimetic matrix
properties. To exemplify the elegant, matrix-mimetic algebraic structure of our
$t$-NNs, we expand on recent work (Haber and Ruthotto, 2017) which interprets
deep neural networks as discretizations of non-linear differential equations
and introduces stable neural networks which promote superior generalization.
Motivated by this dynamic framework, we introduce a stable $t$-NN which
facilitates more rapid learning because of its reduced, more powerful
parameterization. Through our high-dimensional design, we create a more compact
parameter space and extract multidimensional correlations otherwise latent in
traditional algorithms. We further generalize our $t$-NN framework to a family
of tensor-tensor products (Kernfeld, Kilmer, and Aeron, 2015) which still
induce a matrix-mimetic algebraic structure. Through numerical experiments on
the MNIST and CIFAR-10 datasets, we demonstrate the more powerful
parameterizations and improved generalizability of stable $t$-NNs.

20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
8
The categories of this paper are: hep-ex
31
The categories of this paper are: ao-sci
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
37
The categories of this paper are: supr-con