Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Agent-Temporal Attention for Reward Redistribution in Episodic
  Multi-Agent Reinforcement Learning   This paper considers multi-agent reinforcement learning (MARL) tasks where
agents receive a shared global reward at the end of an episode. The delayed
nature of this reward affects the ability of the agents to assess the quality
of their actions at intermediate time-steps. This paper focuses on developing
methods to learn a temporal redistribution of the episodic reward to obtain a
dense reward signal. Solving such MARL problems requires addressing two
challenges: identifying (1) relative importance of states along the length of
an episode (along time), and (2) relative importance of individual agents'
states at any single time-step (among agents). In this paper, we introduce
Agent-Temporal Attention for Reward Redistribution in Episodic Multi-Agent
Reinforcement Learning (AREL) to address these two challenges. AREL uses
attention mechanisms to characterize the influence of actions on state
transitions along trajectories (temporal attention), and how each agent is
affected by other agents at each time-step (agent attention). The redistributed
rewards predicted by AREL are dense, and can be integrated with any given MARL
algorithm. We evaluate AREL on challenging tasks from the Particle World
environment and the StarCraft Multi-Agent Challenge. AREL results in higher
rewards in Particle World, and improved win rates in StarCraft compared to
three state-of-the-art reward redistribution methods. Our code is available at
https://github.com/baicenxiao/AREL.

16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
2
The categories of this paper are: math
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
10
The categories of this paper are: q-bio
28
The categories of this paper are: alg-geom
20
The categories of this paper are: acc-phys
7
The categories of this paper are: hep-th