Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Federated Learning with Lossy Distributed Source Coding: Analysis and
  Optimization   Recently, federated learning (FL), which replaces data sharing with model
sharing, has emerged as an efficient and privacy-friendly paradigm for machine
learning (ML). A main challenge of FL is its huge uplink communication cost. In
this paper, we tackle this challenge from an information-theoretic perspective.
Specifically, we put forth a distributed source coding (DSC) framework for FL
uplink, which unifies the encoding, transmission, and aggregation of the local
updates as a lossy DSC problem, thus providing a systematic way to exploit the
correlation between local updates to improve the uplink efficiency. Under this
DSC-FL framework, we propose an FL uplink scheme based on the modified
Berger-Tung coding (MBTC), which supports separate encoding and joint decoding
by modifying the achievability scheme of the Berger-Tung inner bound. The
achievable region of the MBTC-based uplink scheme is also derived. To unleash
the potential of the MBTC-based FL scheme, we carry out a convergence analysis
and then formulate a convergence rate maximization problem to optimize the
parameters of MBTC. To solve this problem, we develop two algorithms,
respectively for small- and large-scale FL systems, based on the
majorization-minimization (MM) technique. Numerical results demonstrate the
superiority of the MBTC-based FL scheme in terms of aggregation distortion,
convergence performance, and communication cost, revealing the great potential
of the DSC-FL framework.

37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
33
The categories of this paper are: plasm-ph
10
The categories of this paper are: q-bio
13
The categories of this paper are: quant-ph
36
The categories of this paper are: cmp-lg
35
The categories of this paper are: mtrl-th
9
The categories of this paper are: nlin
1
The categories of this paper are: cs
8
The categories of this paper are: hep-ex
15
The categories of this paper are: nucl-ex
27
The categories of this paper are: comp-gas
25
The categories of this paper are: patt-sol
3
The categories of this paper are: physics
29
The categories of this paper are: funct-an
11
The categories of this paper are: hep-lat