Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Device Sampling for Heterogeneous Federated Learning: Theory,
  Algorithms, and Implementation   The conventional federated learning (FedL) architecture distributes machine
learning (ML) across worker devices by having them train local models that are
periodically aggregated by a server. FedL ignores two important characteristics
of contemporary wireless networks, however: (i) the network may contain
heterogeneous communication/computation resources, while (ii) there may be
significant overlaps in devices' local data distributions. In this work, we
develop a novel optimization methodology that jointly accounts for these
factors via intelligent device sampling complemented by device-to-device (D2D)
offloading. Our optimization aims to select the best combination of sampled
nodes and data offloading configuration to maximize FedL training accuracy
subject to realistic constraints on the network topology and device
capabilities. Theoretical analysis of the D2D offloading subproblem leads to
new FedL convergence bounds and an efficient sequential convex optimizer. Using
this result, we develop a sampling methodology based on graph convolutional
networks (GCNs) which learns the relationship between network attributes,
sampled nodes, and resulting offloading that maximizes FedL accuracy. Through
evaluation on real-world datasets and network measurements from our IoT
testbed, we find that our methodology while sampling less than 5% of all
devices outperforms conventional FedL substantially both in terms of trained
model accuracy and required resource utilization.

21
The categories of this paper are: adap-org
31
The categories of this paper are: ao-sci
35
The categories of this paper are: mtrl-th
20
The categories of this paper are: acc-phys
16
The categories of this paper are: stat
24
The categories of this paper are: dg-ga
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
30
The categories of this paper are: q-alg
0
The categories of this paper are: hep-ph
28
The categories of this paper are: alg-geom