Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Multilinear compressive sensing and an application to convolutional
  linear networks   We study a deep linear network endowed with a structure. It takes the form of
a matrix $X$ obtained by multiplying $K$ matrices (called factors and
corresponding to the action of the layers). The action of each layer (i.e. a
factor) is obtained by applying a fixed linear operator to a vector of
parameters satisfying a constraint. The number of layers is not limited.
Assuming that $X$ is given and factors have been estimated, the error between
the product of the estimated factors and $X$ (i.e. the reconstruction error) is
either the statistical or the empirical risk. In this paper, we provide
necessary and sufficient conditions on the network topology under which a
stability property holds. The stability property requires that the error on the
parameters defining the factors (i.e. the stability of the recovered
parameters) scales linearly with the reconstruction error (i.e. the risk).
Therefore, under these conditions on the network topology, any successful
learning task leads to stably defined features and therefore interpretable
layers/network.In order to do so, we first evaluate how the Segre embedding and
its inverse distort distances. Then, we show that any deep structured linear
network can be cast as a generic multilinear problem (that uses the Segre
embedding). This is the {\em tensorial lifting}. Using the tensorial lifting,
we provide necessary and sufficient conditions for the identifiability of the
factors (up to a scale rearrangement). We finally provide the necessary and
sufficient condition called \NSPlong~(because of the analogy with the usual
Null Space Property in the compressed sensing framework) which guarantees that
the stability property holds. We illustrate the theory with a practical example
where the deep structured linear network is a convolutional linear network. As
expected, the conditions are rather strong but not empty. A simple test on the
network topology can be implemented to test if the condition holds.

22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
24
The categories of this paper are: dg-ga
14
The categories of this paper are: math-ph
1
The categories of this paper are: cs