Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Revisiting the Primal-Dual Method of Multipliers for Optimisation over
  Centralised Networks   The primal-dual method of multipliers (PDMM) was originally designed for
solving a decomposable optimisation problem over a general network. In this
paper, we revisit PDMM for optimisation over a centralized network. We first
note that the recently proposed method FedSplit [1] implements PDMM for a
centralized network. In [1], Inexact FedSplit (i.e., gradient based FedSplit)
was also studied both empirically and theoretically. We identify the cause for
the poor reported performance of Inexact FedSplit, which is due to the improper
initialisation in the gradient operations at the client side. To fix the issue
of Inexact FedSplit, we propose two versions of Inexact PDMM, which are
referred to as gradient-based PDMM (GPDMM) and accelerated GPDMM (AGPDMM),
respectively. AGPDMM accelerates GPDMM at the cost of transmitting two times
the number of parameters from the server to each client per iteration compared
to GPDMM. We provide a new convergence bound for GPDMM for a class of convex
optimisation problems. Our new bounds are tighter than those derived for
Inexact FedSplit. We also investigate the update expressions of AGPDMM and
SCAFFOLD to find their similarities. It is found that when the number K of
gradient steps at the client side per iteration is K=1, both AGPDMM and
SCAFFOLD reduce to vanilla gradient descent with proper parameter setup.
Experimental results indicate that AGPDMM converges faster than SCAFFOLD when
K>1 while GPDMM converges slightly worse than SCAFFOLD.

37
The categories of this paper are: supr-con
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
11
The categories of this paper are: hep-lat
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
26
The categories of this paper are: bayes-an
20
The categories of this paper are: acc-phys
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph
36
The categories of this paper are: cmp-lg