Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Bottleneck Time Minimization for Distributed Iterative Processes:
  Speeding Up Gossip-Based Federated Learning on Networked Computers   We present a novel task scheduling scheme for accelerating computational
applications involving distributed iterative processes that are executed on
networked computing resources. Such an application consists of multiple tasks,
each of which outputs data at each iteration to be processed by neighboring
tasks; these dependencies between the tasks can be represented as a directed
graph. We first mathematically formulate the problem as a Binary Quadratic
Program (BQP), accounting for both computation and communication costs. We show
that the problem is NP-hard. We then relax the problem as a Semi-Definite
Program (SDP) and utilize a randomized rounding technique based on sampling
from a suitably-formulated multi-variate Gaussian distribution. Furthermore, we
derive the expected value of bottleneck time. Finally, we apply our proposed
scheme on gossip-based federated learning as an application of iterative
processes. Through numerical evaluations on the MNIST and CIFAR-10 datasets, we
show that our proposed approach outperforms well-known scheduling techniques
from distributed computing. In particular, for arbitrary settings, we show that
it reduces bottleneck time by $91\%$ compared to HEFT and $84\%$ compared to
throughput HEFT.

6
The categories of this paper are: astro-ph
25
The categories of this paper are: patt-sol
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
0
The categories of this paper are: hep-ph
26
The categories of this paper are: bayes-an
16
The categories of this paper are: stat
33
The categories of this paper are: plasm-ph
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
14
The categories of this paper are: math-ph
3
The categories of this paper are: physics