Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Parameter Sharing For Heterogeneous Agents in Multi-Agent Reinforcement
  Learning   Parameter sharing, where each agent independently learns a policy with fully
shared parameters between all policies, is a popular baseline method for
multi-agent deep reinforcement learning. Unfortunately, since all agents share
the same policy network, they cannot learn different policies or tasks. This
issue has been circumvented experimentally by adding an agent-specific
indicator signal to observations, which we term "agent indication." Agent
indication is limited, however, in that without modification it does not allow
parameter sharing to be applied to environments where the action spaces and/or
observation spaces are heterogeneous. This work formalizes the notion of agent
indication and proves that it enables convergence to optimal policies for the
first time. Next, we formally introduce methods to extend parameter sharing to
learning in heterogeneous observation and action spaces, and prove that these
methods allow for convergence to optimal policies. Finally, we experimentally
confirm that the methods we introduce function empirically, and conduct a wide
array of experiments studying the empirical efficacy of many different agent
indication schemes for graphical observation spaces.

35
The categories of this paper are: mtrl-th
30
The categories of this paper are: q-alg
23
The categories of this paper are: solv-int
4
The categories of this paper are: cond-mat
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
2
The categories of this paper are: math
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
12
The categories of this paper are: nucl-th
26
The categories of this paper are: bayes-an
3
The categories of this paper are: physics
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
36
The categories of this paper are: cmp-lg