Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning Cooperative Multi-Agent Policies with Partial Reward Decoupling   One of the preeminent obstacles to scaling multi-agent reinforcement learning
to large numbers of agents is assigning credit to individual agents' actions.
In this paper, we address this credit assignment problem with an approach that
we call \textit{partial reward decoupling} (PRD), which attempts to decompose
large cooperative multi-agent RL problems into decoupled subproblems involving
subsets of agents, thereby simplifying credit assignment. We empirically
demonstrate that decomposing the RL problem using PRD in an actor-critic
algorithm results in lower variance policy gradient estimates, which improves
data efficiency, learning stability, and asymptotic performance across a wide
array of multi-agent RL tasks, compared to various other actor-critic
approaches. Additionally, we relate our approach to counterfactual multi-agent
policy gradient (COMA), a state-of-the-art MARL algorithm, and empirically show
that our approach outperforms COMA by making better use of information in
agents' reward streams, and by enabling recent advances in advantage estimation
to be used.

10
The categories of this paper are: q-bio
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
26
The categories of this paper are: bayes-an
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol