Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Model-based Multi-agent Policy Optimization with Adaptive Opponent-wise
  Rollouts   This paper investigates the model-based methods in multi-agent reinforcement
learning (MARL). We specify the dynamics sample complexity and the opponent
sample complexity in MARL, and conduct a theoretic analysis of return
discrepancy upper bound. To reduce the upper bound with the intention of low
sample complexity during the whole learning process, we propose a novel
decentralized model-based MARL method, named Adaptive Opponent-wise Rollout
Policy Optimization (AORPO). In AORPO, each agent builds its multi-agent
environment model, consisting of a dynamics model and multiple opponent models,
and trains its policy with the adaptive opponent-wise rollout. We further prove
the theoretic convergence of AORPO under reasonable assumptions. Empirical
experiments on competitive and cooperative tasks demonstrate that AORPO can
achieve improved sample efficiency with comparable asymptotic performance over
the compared MARL methods.

35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
19
The categories of this paper are: eess
33
The categories of this paper are: plasm-ph
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
9
The categories of this paper are: nlin
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph