Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Sample and Communication-Efficient Decentralized Actor-Critic Algorithms
  with Finite-Time Analysis   Actor-critic (AC) algorithms have been widely adopted in decentralized
multi-agent systems to learn the optimal joint control policy. However,
existing decentralized AC algorithms either do not preserve the privacy of
agents or are not sample and communication-efficient. In this work, we develop
two decentralized AC and natural AC (NAC) algorithms that are private, and
sample and communication-efficient. In both algorithms, agents share noisy
information to preserve privacy and adopt mini-batch updates to improve sample
and communication efficiency. Particularly for decentralized NAC, we develop a
decentralized Markovian SGD algorithm with an adaptive mini-batch size to
efficiently compute the natural policy gradient. Under Markovian sampling and
linear function approximation, we prove the proposed decentralized AC and NAC
algorithms achieve the state-of-the-art sample complexities
$\mathcal{O}\big(\epsilon^{-2}\ln(\epsilon^{-1})\big)$ and
$\mathcal{O}\big(\epsilon^{-3}\ln(\epsilon^{-1})\big)$, respectively, and the
same small communication complexity
$\mathcal{O}\big(\epsilon^{-1}\ln(\epsilon^{-1})\big)$. Numerical experiments
demonstrate that the proposed algorithms achieve lower sample and communication
complexities than the existing decentralized AC algorithm.

11
The categories of this paper are: hep-lat
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
22
The categories of this paper are: chao-dyn
13
The categories of this paper are: quant-ph
20
The categories of this paper are: acc-phys
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
8
The categories of this paper are: hep-ex
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio