Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Maximum Multiscale Entropy and Neural Network Regularization   A well-known result across information theory, machine learning, and
statistical physics shows that the maximum entropy distribution under a mean
constraint has an exponential form called the Gibbs-Boltzmann distribution.
This is used for instance in density estimation or to achieve excess risk
bounds derived from single-scale entropy regularizers (Xu-Raginsky '17). This
paper investigates a generalization of these results to a multiscale setting.
We present different ways of generalizing the maximum entropy result by
incorporating the notion of scale. For different entropies and arbitrary scale
transformations, it is shown that the distribution maximizing a multiscale
entropy is characterized by a procedure which has an analogy to the
renormalization group procedure in statistical physics. For the case of
decimation transformation, it is further shown that this distribution is
Gaussian whenever the optimal single-scale distribution is Gaussian. This is
then applied to neural networks, and it is shown that in a teacher-student
scenario, the multiscale Gibbs posterior can achieve a smaller excess risk than
the single-scale Gibbs posterior.

19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
4
The categories of this paper are: cond-mat
10
The categories of this paper are: q-bio
27
The categories of this paper are: comp-gas
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
14
The categories of this paper are: math-ph
31
The categories of this paper are: ao-sci