Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Optimal Coordinated Planning Amongst Self-Interested Agents with Private
  State   Consider a multi-agent system in a dynamic and uncertain environment. Each
agent's local decision problem is modeled as a Markov decision process (MDP)
and agents must coordinate on a joint action in each period, which provides a
reward to each agent and causes local state transitions. A social planner knows
the model of every agent's MDP and wants to implement the optimal joint policy,
but agents are self-interested and have private local state. We provide an
incentive-compatible mechanism for eliciting state information that achieves
the optimal joint plan in a Markov perfect equilibrium of the induced
stochastic game. In the special case in which local problems are Markov chains
and agents compete to take a single action in each period, we leverage Gittins
allocation indices to provide an efficient factored algorithm and distribute
computation of the optimal policy among the agents. Distributed, optimal
coordinated learning in a multi-agent variant of the multi-armed bandit problem
is obtained as a special case.

33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
27
The categories of this paper are: comp-gas
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
34
The categories of this paper are: chem-ph
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
5
The categories of this paper are: gr-qc
9
The categories of this paper are: nlin
6
The categories of this paper are: astro-ph
25
The categories of this paper are: patt-sol