Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Communication-Efficient Consensus Mechanism for Federated Reinforcement
  Learning   The paper considers independent reinforcement learning (IRL) for multi-agent
decision-making process in the paradigm of federated learning (FL). We show
that FL can clearly improve the policy performance of IRL in terms of training
efficiency and stability. However, since the policy parameters are trained
locally and aggregated iteratively through a central server in FL, frequent
information exchange incurs a large amount of communication overheads. To reach
a good balance between improving the model's convergence performance and
reducing the required communication and computation overheads, this paper
proposes a system utility function and develops a consensus-based optimization
scheme on top of the periodic averaging method, which introduces the consensus
algorithm into FL for the exchange of a model's local gradients. This paper
also provides novel convergence guarantees for the developed method, and
demonstrates its superior effectiveness and efficiency in improving the system
utility value through theoretical analyses and numerical simulation results.

28
The categories of this paper are: alg-geom
33
The categories of this paper are: plasm-ph
19
The categories of this paper are: eess
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
14
The categories of this paper are: math-ph
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
26
The categories of this paper are: bayes-an
30
The categories of this paper are: q-alg
6
The categories of this paper are: astro-ph
3
The categories of this paper are: physics
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex