Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Compositional Reinforcement Learning from Logical Specifications   We study the problem of learning control policies for complex tasks given by
logical specifications. Recent approaches automatically generate a reward
function from a given specification and use a suitable reinforcement learning
algorithm to learn a policy that maximizes the expected reward. These
approaches, however, scale poorly to complex tasks that require high-level
planning. In this work, we develop a compositional learning approach, called
DiRL, that interleaves high-level planning and reinforcement learning. First,
DiRL encodes the specification as an abstract graph; intuitively, vertices and
edges of the graph correspond to regions of the state space and simpler
sub-tasks, respectively. Our approach then incorporates reinforcement learning
to learn neural network policies for each edge (sub-task) within a
Dijkstra-style planning algorithm to compute a high-level plan in the graph. An
evaluation of the proposed approach on a set of challenging control benchmarks
with continuous state and action spaces demonstrates that it outperforms
state-of-the-art baselines.

27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
25
The categories of this paper are: patt-sol
10
The categories of this paper are: q-bio
31
The categories of this paper are: ao-sci
32
The categories of this paper are: atom-ph