Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Inferring the Optimal Policy using Markov Chain Monte Carlo   This paper investigates methods for estimating the optimal stochastic control
policy for a Markov Decision Process with unknown transition dynamics and an
unknown reward function. This form of model-free reinforcement learning
comprises many real world systems such as playing video games, simulated
control tasks, and real robot locomotion. Existing methods for estimating the
optimal stochastic control policy rely on high variance estimates of the policy
descent. However, these methods are not guaranteed to find the optimal
stochastic policy, and the high variance gradient estimates make convergence
unstable. In order to resolve these problems, we propose a technique using
Markov Chain Monte Carlo to generate samples from the posterior distribution of
the parameters conditioned on being optimal. Our method provably converges to
the globally optimal stochastic policy, and empirically similar variance
compared to the policy gradient.

19
The categories of this paper are: eess
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
0
The categories of this paper are: hep-ph
5
The categories of this paper are: gr-qc
17
The categories of this paper are: q-fin
26
The categories of this paper are: bayes-an
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
8
The categories of this paper are: hep-ex
11
The categories of this paper are: hep-lat
20
The categories of this paper are: acc-phys
9
The categories of this paper are: nlin