Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Generalized AdaGrad (G-AdaGrad) and Adam: A State-Space Perspective   Accelerated gradient-based methods are being extensively used for solving
non-convex machine learning problems, especially when the data points are
abundant or the available data is distributed across several agents. Two of the
prominent accelerated gradient algorithms are AdaGrad and Adam. AdaGrad is the
simplest accelerated gradient method, which is particularly effective for
sparse data. Adam has been shown to perform favorably in deep learning problems
compared to other methods. In this paper, we propose a new fast optimizer,
Generalized AdaGrad (G-AdaGrad), for accelerating the solution of potentially
non-convex machine learning problems. Specifically, we adopt a state-space
perspective for analyzing the convergence of gradient acceleration algorithms,
namely G-AdaGrad and Adam, in machine learning. Our proposed state-space models
are governed by ordinary differential equations. We present simple convergence
proofs of these two algorithms in the deterministic settings with minimal
assumptions. Our analysis also provides intuition behind improving upon
AdaGrad's convergence rate. We provide empirical results on MNIST dataset to
reinforce our claims on the convergence and performance of G-AdaGrad and Adam.

3
The categories of this paper are: physics
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
29
The categories of this paper are: funct-an
24
The categories of this paper are: dg-ga
32
The categories of this paper are: atom-ph
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th