Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Perturbed Iterate Analysis for Asynchronous Stochastic Optimization   We introduce and analyze stochastic optimization methods where the input to
each gradient update is perturbed by bounded noise. We show that this framework
forms the basis of a unified approach to analyze asynchronous implementations
of stochastic optimization algorithms.In this framework, asynchronous
stochastic optimization algorithms can be thought of as serial methods
operating on noisy inputs. Using our perturbed iterate framework, we provide
new analyses of the Hogwild! algorithm and asynchronous stochastic coordinate
descent, that are simpler than earlier analyses, remove many assumptions of
previous models, and in some cases yield improved upper bounds on the
convergence rates. We proceed to apply our framework to develop and analyze
KroMagnon: a novel, parallel, sparse stochastic variance-reduced gradient
(SVRG) algorithm. We demonstrate experimentally on a 16-core machine that the
sparse and parallel version of SVRG is in some cases more than four orders of
magnitude faster than the standard SVRG algorithm.

20
The categories of this paper are: acc-phys
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
32
The categories of this paper are: atom-ph
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
5
The categories of this paper are: gr-qc