Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: The Loss Surfaces of Neural Networks with General Activation Functions   The loss surfaces of deep neural networks have been the subject of several
studies, theoretical and experimental, over the last few years. One strand of
work considers the complexity, in the sense of local optima, of high
dimensional random functions with the aim of informing how local optimisation
methods may perform in such complicated settings. Prior work of Choromanska et
al (2015) established a direct link between the training loss surfaces of deep
multi-layer perceptron networks and spherical multi-spin glass models under
some very strong assumptions on the network and its data. In this work, we test
the validity of this approach by removing the undesirable restriction to ReLU
activation functions. In doing so, we chart a new path through the spin glass
complexity calculations using supersymmetric methods in Random Matrix Theory
which may prove useful in other contexts. Our results shed new light on both
the strengths and the weaknesses of spin glass models in this context.

3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
28
The categories of this paper are: alg-geom
17
The categories of this paper are: q-fin
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
26
The categories of this paper are: bayes-an
5
The categories of this paper are: gr-qc