Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Bayes-CPACE: PAC Optimal Exploration in Continuous Space Bayes-Adaptive
  Markov Decision Processes   We present the first PAC optimal algorithm for Bayes-Adaptive Markov Decision
Processes (BAMDPs) in continuous state and action spaces, to the best of our
knowledge. The BAMDP framework elegantly addresses model uncertainty by
incorporating Bayesian belief updates into long-term expected return. However,
computing an exact optimal Bayesian policy is intractable. Our key insight is
to compute a near-optimal value function by covering the continuous
state-belief-action space with a finite set of representative samples and
exploiting the Lipschitz continuity of the value function. We prove the
near-optimality of our algorithm and analyze a number of schemes that boost the
algorithm's efficiency. Finally, we empirically validate our approach on a
number of discrete and continuous BAMDPs and show that the learned policy has
consistently competitive performance against baseline approaches.

22
The categories of this paper are: chao-dyn
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
17
The categories of this paper are: q-fin
2
The categories of this paper are: math
30
The categories of this paper are: q-alg
36
The categories of this paper are: cmp-lg
15
The categories of this paper are: nucl-ex
20
The categories of this paper are: acc-phys
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
18
The categories of this paper are: econ
3
The categories of this paper are: physics
19
The categories of this paper are: eess