Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Deep Autoencoders: From Understanding to Generalization Guarantees   A big mystery in deep learning continues to be the ability of methods to
generalize when the number of model parameters is larger than the number of
training examples. In this work, we take a step towards a better understanding
of the underlying phenomena of Deep Autoencoders (AEs), a mainstream deep
learning solution for learning compressed, interpretable, and structured data
representations. In particular, we interpret how AEs approximate the data
manifold by exploiting their continuous piecewise affine structure. Our
reformulation of AEs provides new insights into their mapping, reconstruction
guarantees, as well as an interpretation of commonly used regularization
techniques. We leverage these findings to derive two new regularizations that
enable AEs to capture the inherent symmetry in the data. Our regularizations
leverage recent advances in the group of transformation learning to enable AEs
to better approximate the data manifold without explicitly defining the group
underlying the manifold. Under the assumption that the symmetry of the data can
be explained by a Lie group, we prove that the regularizations ensure the
generalization of the corresponding AEs. A range of experimental evaluations
demonstrate that our methods outperform other state-of-the-art regularization
techniques.

29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
24
The categories of this paper are: dg-ga
30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
10
The categories of this paper are: q-bio
19
The categories of this paper are: eess
7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph