Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Batch Policy Learning under Constraints   When learning policies for real-world domains, two important questions arise:
(i) how to efficiently use pre-collected off-policy, non-optimal behavior data;
and (ii) how to mediate among different competing objectives and constraints.
We thus study the problem of batch policy learning under multiple constraints,
and offer a systematic solution. We first propose a flexible meta-algorithm
that admits any batch reinforcement learning and online learning procedure as
subroutines. We then present a specific algorithmic instantiation and provide
performance guarantees for the main objective and all constraints. To certify
constraint satisfaction, we propose a new and simple method for off-policy
policy evaluation (OPE) and derive PAC-style bounds. Our algorithm achieves
strong empirical results in different domains, including in a challenging
problem of simulated car driving subject to multiple constraints such as lane
keeping and smooth driving. We also show experimentally that our OPE method
outperforms other popular OPE techniques on a standalone basis, especially in a
high-dimensional setting.

24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
10
The categories of this paper are: q-bio
14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
0
The categories of this paper are: hep-ph
19
The categories of this paper are: eess
31
The categories of this paper are: ao-sci
15
The categories of this paper are: nucl-ex
33
The categories of this paper are: plasm-ph