Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modelling Behavioural Diversity for Learning in Open-Ended Games   Promoting behavioural diversity is critical for solving games with
non-transitive dynamics where strategic cycles exist, and there is no
consistent winner (e.g., Rock-Paper-Scissors). Yet, there is a lack of rigorous
treatment for defining diversity and constructing diversity-aware learning
dynamics. In this work, we offer a geometric interpretation of behavioural
diversity in games and introduce a novel diversity metric based on
determinantal point processes (DPP). By incorporating the diversity metric into
best-response dynamics, we develop diverse fictitious play and diverse
policy-space response oracle for solving normal-form games and open-ended
games. We prove the uniqueness of the diverse best response and the convergence
of our algorithms on two-player games. Importantly, we show that maximising the
DPP-based diversity metric guarantees to enlarge the gamescape -- convex
polytopes spanned by agents' mixtures of strategies. To validate our
diversity-aware solvers, we test on tens of games that show strong
non-transitivity. Results suggest that our methods achieve at least the same,
and in most games, lower exploitability than PSRO solvers by finding effective
and diverse strategies.

22
The categories of this paper are: chao-dyn
15
The categories of this paper are: nucl-ex
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
31
The categories of this paper are: ao-sci
6
The categories of this paper are: astro-ph
8
The categories of this paper are: hep-ex
7
The categories of this paper are: hep-th
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
3
The categories of this paper are: physics
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
12
The categories of this paper are: nucl-th