Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Formalization of The Natural Gradient Method for General Similarity
  Measures   In optimization, the natural gradient method is well-known for likelihood
maximization. The method uses the Kullback-Leibler divergence, corresponding
infinitesimally to the Fisher-Rao metric, which is pulled back to the parameter
space of a family of probability distributions. This way, gradients with
respect to the parameters respect the Fisher-Rao geometry of the space of
distributions, which might differ vastly from the standard Euclidean geometry
of the parameter space, often leading to faster convergence. However, when
minimizing an arbitrary similarity measure between distributions, it is
generally unclear which metric to use. We provide a general framework that,
given a similarity measure, derives a metric for the natural gradient. We then
discuss connections between the natural gradient method and multiple other
optimization techniques in the literature. Finally, we provide computations of
the formal natural gradient to show overlap with well-known cases and to
compute natural gradients in novel frameworks.

2
The categories of this paper are: math
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
29
The categories of this paper are: funct-an
23
The categories of this paper are: solv-int