Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: A Generalized Training Approach for Multiagent Learning   This paper investigates a population-based training regime based on
game-theoretic principles called Policy-Spaced Response Oracles (PSRO). PSRO is
general in the sense that it (1) encompasses well-known algorithms such as
fictitious play and double oracle as special cases, and (2) in principle
applies to general-sum, many-player games. Despite this, prior studies of PSRO
have been focused on two-player zero-sum games, a regime wherein Nash
equilibria are tractably computable. In moving from two-player zero-sum games
to more general settings, computation of Nash equilibria quickly becomes
infeasible. Here, we extend the theoretical underpinnings of PSRO by
considering an alternative solution concept, $\alpha$-Rank, which is unique
(thus faces no equilibrium selection issues, unlike Nash) and applies readily
to general-sum, many-player settings. We establish convergence guarantees in
several games classes, and identify links between Nash equilibria and
$\alpha$-Rank. We demonstrate the competitive performance of
$\alpha$-Rank-based PSRO against an exact Nash solver-based PSRO in 2-player
Kuhn and Leduc Poker. We then go beyond the reach of prior PSRO applications by
considering 3- to 5-player poker games, yielding instances where $\alpha$-Rank
achieves faster convergence than approximate Nash solvers, thus establishing it
as a favorable general games solver. We also carry out an initial empirical
validation in MuJoCo soccer, illustrating the feasibility of the proposed
approach in another complex domain.

22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
29
The categories of this paper are: funct-an
34
The categories of this paper are: chem-ph
9
The categories of this paper are: nlin
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
12
The categories of this paper are: nucl-th
3
The categories of this paper are: physics
16
The categories of this paper are: stat
0
The categories of this paper are: hep-ph
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
35
The categories of this paper are: mtrl-th
36
The categories of this paper are: cmp-lg