Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Sublinear Convergence of Randomly Perturbed Alternating Gradient
  Descent to Second Order Stationary Solutions   The alternating gradient descent (AGD) is a simple but popular algorithm
which has been applied to problems in optimization, machine learning, data
ming, and signal processing, etc. The algorithm updates two blocks of variables
in an alternating manner, in which a gradient step is taken on one block, while
keeping the remaining block fixed. When the objective function is nonconvex, it
is well-known the AGD converges to the first-order stationary solution with a
global sublinear rate.
  In this paper, we show that a variant of AGD-type algorithms will not be
trapped by "bad" stationary solutions such as saddle points and local maximum
points. In particular, we consider a smooth unconstrained optimization problem,
and propose a perturbed AGD (PA-GD) which converges (with high probability) to
the set of second-order stationary solutions (SS2) with a global sublinear
rate. To the best of our knowledge, this is the first alternating type
algorithm which takes $\mathcal{O}(\text{polylog}(d)/\epsilon^{7/3})$
iterations to achieve SS2 with high probability [where polylog$(d)$ is
polynomial of the logarithm of dimension $d$ of the problem].

3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
4
The categories of this paper are: cond-mat
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
12
The categories of this paper are: nucl-th