Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Almost Optimal Algorithms for Two-player Zero-Sum Linear Mixture Markov
  Games   We study reinforcement learning for two-player zero-sum Markov games with
simultaneous moves in the finite-horizon setting, where the transition kernel
of the underlying Markov games can be parameterized by a linear function over
the current state, both players' actions and the next state. In particular, we
assume that we can control both players and aim to find the Nash Equilibrium by
minimizing the duality gap. We propose an algorithm Nash-UCRL based on the
principle "Optimism-in-Face-of-Uncertainty". Our algorithm only needs to find a
Coarse Correlated Equilibrium (CCE), which is computationally efficient.
Specifically, we show that Nash-UCRL can provably achieve an
$\tilde{O}(dH\sqrt{T})$ regret, where $d$ is the linear function dimension, $H$
is the length of the game and $T$ is the total number of steps in the game. To
assess the optimality of our algorithm, we also prove an $\tilde{\Omega}(
dH\sqrt{T})$ lower bound on the regret. Our upper bound matches the lower bound
up to logarithmic factors, which suggests the optimality of our algorithm.

13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
15
The categories of this paper are: nucl-ex
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
29
The categories of this paper are: funct-an
21
The categories of this paper are: adap-org
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
24
The categories of this paper are: dg-ga