Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Depth creates no more spurious local minima   We show that for any convex differentiable loss, a deep linear network has no
spurious local minima as long as it is true for the two layer case. This
reduction greatly simplifies the study on the existence of spurious local
minima in deep linear networks. When applied to the quadratic loss, our result
immediately implies the powerful result in [Kawaguchi 2016]. Further, with the
work in [Zhou and Liang 2018], we can remove all the assumptions in [Kawaguchi
2016]. This property holds for more general "multi-tower" linear networks too.
Our proof builds on [Laurent and von Brecht 2018] and develops a new
perturbation argument to show that any spurious local minimum must have full
rank, a structural property which can be useful more generally.

15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
18
The categories of this paper are: econ
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
21
The categories of this paper are: adap-org