Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Privacy-preserving Incremental ADMM for Decentralized Consensus
  Optimization   The alternating direction method of multipliers (ADMM) has been recently
recognized as a promising optimizer for large-scale machine learning models.
However, there are very few results studying ADMM from the aspect of
communication costs, especially jointly with privacy preservation, which are
critical for distributed learning. We investigate the communication efficiency
and privacy-preservation of ADMM by solving the consensus optimization problem
over decentralized networks. Since walk algorithms can reduce communication
load, we first propose incremental ADMM (I-ADMM) based on the walk algorithm,
the updating order of which follows a Hamiltonian cycle instead. However,
I-ADMM cannot guarantee the privacy for agents against external eavesdroppers
even if the randomized initialization is applied. To protect privacy for
agents, we then propose two privacy-preserving incremental ADMM algorithms,
i.e., PI-ADMM1 and PI-ADMM2, where perturbation over step sizes and primal
variables is adopted, respectively. Through theoretical analyses, we prove the
convergence and privacy preservation for PI-ADMM1, which are further supported
by numerical experiments. Besides, simulations demonstrate that the proposed
PI-ADMM1 and PI-ADMM2 algorithms are communication efficient compared with
state-of-the-art methods.

0
The categories of this paper are: hep-ph
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
37
The categories of this paper are: supr-con
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
13
The categories of this paper are: quant-ph
11
The categories of this paper are: hep-lat
34
The categories of this paper are: chem-ph
9
The categories of this paper are: nlin
16
The categories of this paper are: stat
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
14
The categories of this paper are: math-ph
27
The categories of this paper are: comp-gas