Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Variance-Reduced Stochastic Quasi-Newton Methods for Decentralized
  Learning: Part I   In this work, we investigate stochastic quasi-Newton methods for minimizing a
finite sum of cost functions over a decentralized network. In Part I, we
develop a general algorithmic framework that incorporates stochastic
quasi-Newton approximations with variance reduction so as to achieve fast
convergence. At each time each node constructs a local, inexact quasi-Newton
direction that asymptotically approaches the global, exact one. To be specific,
(i) A local gradient approximation is constructed by using dynamic average
consensus to track the average of variance-reduced local stochastic gradients
over the entire network; (ii) A local Hessian inverse approximation is assumed
to be positive definite with bounded eigenvalues, and how to construct it to
satisfy these assumptions will be given in Part II. Compared to the existing
decentralized stochastic first-order methods, the proposed general framework
introduces the second-order curvature information without incurring extra
sampling or communication. With a fixed step size, we establish the conditions
under which the proposed general framework linearly converges to an exact
optimal solution.

22
The categories of this paper are: chao-dyn
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
12
The categories of this paper are: nucl-th
11
The categories of this paper are: hep-lat
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas