Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Program Synthesis Guided Reinforcement Learning for Partially Observed
  Environments   A key challenge for reinforcement learning is solving long-horizon planning
problems. Recent work has leveraged programs to guide reinforcement learning in
these settings. However, these approaches impose a high manual burden on the
user since they must provide a guiding program for every new task. Partially
observed environments further complicate the programming task because the
program must implement a strategy that correctly, and ideally optimally,
handles every possible configuration of the hidden regions of the environment.
We propose a new approach, model predictive program synthesis (MPPS), that uses
program synthesis to automatically generate the guiding programs. It trains a
generative model to predict the unobserved portions of the world, and then
synthesizes a program based on samples from this model in a way that is robust
to its uncertainty. In our experiments, we show that our approach significantly
outperforms non-program-guided approaches on a set of challenging benchmarks,
including a 2D Minecraft-inspired environment where the agent must complete a
complex sequence of subtasks to achieve its goal, and achieves a similar
performance as using handcrafted programs to guide the agent. Our results
demonstrate that our approach can obtain the benefits of program-guided
reinforcement learning without requiring the user to provide a new guiding
program for every new task.

33
The categories of this paper are: plasm-ph
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat
12
The categories of this paper are: nucl-th
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom