Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adaptive First-and Zeroth-order Methods for Weakly Convex Stochastic
  Optimization Problems   In this paper, we design and analyze a new family of adaptive subgradient
methods for solving an important class of weakly convex (possibly nonsmooth)
stochastic optimization problems. Adaptive methods that use exponential moving
averages of past gradients to update search directions and learning rates have
recently attracted a lot of attention for solving optimization problems that
arise in machine learning. Nevertheless, their convergence analysis almost
exclusively requires smoothness and/or convexity of the objective function. In
contrast, we establish non-asymptotic rates of convergence of first and
zeroth-order adaptive methods and their proximal variants for a reasonably
broad class of nonsmooth \& nonconvex optimization problems. Experimental
results indicate how the proposed algorithms empirically outperform stochastic
gradient descent and its zeroth-order variant for solving such optimization
problems.

36
The categories of this paper are: cmp-lg
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
22
The categories of this paper are: chao-dyn
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
21
The categories of this paper are: adap-org
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
18
The categories of this paper are: econ