Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Approximate Policy Iteration with a Policy Language Bias: Solving
  Relational Markov Decision Processes   We study an approach to policy selection for large relational Markov Decision
Processes (MDPs). We consider a variant of approximate policy iteration (API)
that replaces the usual value-function learning step with a learning step in
policy space. This is advantageous in domains where good policies are easier to
represent and learn than the corresponding value functions, which is often the
case for the relational MDPs we are interested in. In order to apply API to
such problems, we introduce a relational policy language and corresponding
learner. In addition, we introduce a new bootstrapping routine for goal-based
planning domains, based on random walks. Such bootstrapping is necessary for
many large relational MDPs, where reward is extremely sparse, as API is
ineffective in such domains when initialized with an uninformed policy. Our
experiments show that the resulting system is able to find good policies for a
number of classical planning domains and their stochastic variants by solving
them as extremely large relational MDPs. The experiments also point to some
limitations of our approach, suggesting future work.

11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
24
The categories of this paper are: dg-ga
30
The categories of this paper are: q-alg
10
The categories of this paper are: q-bio
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
13
The categories of this paper are: quant-ph
8
The categories of this paper are: hep-ex
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
27
The categories of this paper are: comp-gas
2
The categories of this paper are: math