Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On the Powerball Method for Optimization   We propose a new method to accelerate the convergence of optimization
algorithms. This method simply adds a power coefficient $\gamma\in[0,1)$ to the
gradient during optimization. We call this the Powerball method and analyze the
convergence rate for the Powerball method for strongly convex functions. While
theoretically the Powerball method is guaranteed to have a linear convergence
rate in the same order of the gradient method, we show that empirically it
significantly outperforms the gradient descent and Newton's method, especially
during the initial iterations. We demonstrate that the Powerball method
provides a $10$-fold speedup of the convergence of both gradient descent and
L-BFGS on multiple real datasets.

33
The categories of this paper are: plasm-ph
16
The categories of this paper are: stat
28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
31
The categories of this paper are: ao-sci
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
21
The categories of this paper are: adap-org
34
The categories of this paper are: chem-ph
6
The categories of this paper are: astro-ph
10
The categories of this paper are: q-bio
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con