Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Distributed Machine Learning with Sparse Heterogeneous Data   Motivated by distributed machine learning settings such as Federated
Learning, we consider the problem of fitting a statistical model across a
distributed collection of heterogeneous data sets whose similarity structure is
encoded by a graph topology. Precisely, we analyse the case where each node is
associated with fitting a sparse linear model, and edges join two nodes if the
difference of their solutions is also sparse. We propose a method based on
Basis Pursuit Denoising with a total variation penalty, and provide finite
sample guarantees for sub-Gaussian design matrices. Taking the root of the tree
as a reference node, we show that if the sparsity of the differences across
nodes is smaller than the sparsity at the root, then recovery is successful
with fewer samples than by solving the problems independently, or by using
methods that rely on a large overlap in the signal supports, such as the group
Lasso. We consider both the noiseless and noisy setting, and numerically
investigate the performance of distributed methods based on Distributed
Alternating Direction Methods of Multipliers (ADMM) and hyperspectral unmixing.

33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th
19
The categories of this paper are: eess
22
The categories of this paper are: chao-dyn
6
The categories of this paper are: astro-ph
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
32
The categories of this paper are: atom-ph
17
The categories of this paper are: q-fin
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph
37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc