Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Gradient tracking and variance reduction for decentralized optimization
  and machine learning   Decentralized methods to solve finite-sum minimization problems are important
in many signal processing and machine learning tasks where the data is
distributed over a network of nodes and raw data sharing is not permitted due
to privacy and/or resource constraints. In this article, we review
decentralized stochastic first-order methods and provide a unified algorithmic
framework that combines variance-reduction with gradient tracking to achieve
both robust performance and fast convergence. We provide explicit theoretical
guarantees of the corresponding methods when the objective functions are smooth
and strongly-convex, and show their applicability to non-convex problems via
numerical experiments. Throughout the article, we provide intuitive
illustrations of the main technical ideas by casting appropriate tradeoffs and
comparisons among the methods of interest and by highlighting applications to
decentralized training of machine learning models.

23
The categories of this paper are: solv-int
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
34
The categories of this paper are: chem-ph
20
The categories of this paper are: acc-phys
37
The categories of this paper are: supr-con
22
The categories of this paper are: chao-dyn
33
The categories of this paper are: plasm-ph
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
3
The categories of this paper are: physics
10
The categories of this paper are: q-bio