Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reward Design in Cooperative Multi-agent Reinforcement Learning for
  Packet Routing   In cooperative multi-agent reinforcement learning (MARL), how to design a
suitable reward signal to accelerate learning and stabilize convergence is a
critical problem. The global reward signal assigns the same global reward to
all agents without distinguishing their contributions, while the local reward
signal provides different local rewards to each agent based solely on
individual behavior. Both of the two reward assignment approaches have some
shortcomings: the former might encourage lazy agents, while the latter might
produce selfish agents.
  In this paper, we study reward design problem in cooperative MARL based on
packet routing environments. Firstly, we show that the above two reward signals
are prone to produce suboptimal policies. Then, inspired by some observations
and considerations, we design some mixed reward signals, which are
off-the-shelf to learn better policies. Finally, we turn the mixed reward
signals into the adaptive counterparts, which achieve best results in our
experiments. Other reward signals are also discussed in this paper. As reward
design is a very fundamental problem in RL and especially in MARL, we hope that
MARL researchers can rethink the rewards used in their systems.

19
The categories of this paper are: eess
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
16
The categories of this paper are: stat
9
The categories of this paper are: nlin
3
The categories of this paper are: physics
2
The categories of this paper are: math
7
The categories of this paper are: hep-th
33
The categories of this paper are: plasm-ph
26
The categories of this paper are: bayes-an