Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: DEED: A General Quantization Scheme for Communication Efficiency in Bits   In distributed optimization, a popular technique to reduce communication is
quantization. In this paper, we provide a general analysis framework for
inexact gradient descent that is applicable to quantization schemes. We also
propose a quantization scheme Double Encoding and Error Diminishing (DEED).
DEED can achieve small communication complexity in three settings:
frequent-communication large-memory, frequent-communication small-memory, and
infrequent-communication (e.g. federated learning). More specifically, in the
frequent-communication large-memory setting, DEED can be easily combined with
Nesterov's method, so that the total number of bits required is $\tilde{O}(
\sqrt{\kappa} \log 1/\epsilon )$, where $\tilde{O}$ hides numerical constant
and $\log \kappa$ factors. In the frequent-communication small-memory setting,
DEED combined with SGD only requires $\tilde{O}( \kappa \log 1/\epsilon)$
number of bits in the interpolation regime. In the infrequent communication
setting, DEED combined with Federated averaging requires a smaller total number
of bits than Federated Averaging. All these algorithms converge at the same
rate as their non-quantized versions, while using a smaller number of bits.

16
The categories of this paper are: stat
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
26
The categories of this paper are: bayes-an
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
13
The categories of this paper are: quant-ph
35
The categories of this paper are: mtrl-th
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio
17
The categories of this paper are: q-fin
27
The categories of this paper are: comp-gas