Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Expert-Supervised Reinforcement Learning for Offline Policy Learning and
  Evaluation   Offline Reinforcement Learning (RL) is a promising approach for learning
optimal policies in environments where direct exploration is expensive or
unfeasible. However, the adoption of such policies in practice is often
challenging, as they are hard to interpret within the application context, and
lack measures of uncertainty for the learned policy value and its decisions. To
overcome these issues, we propose an Expert-Supervised RL (ESRL) framework
which uses uncertainty quantification for offline policy learning. In
particular, we have three contributions: 1) the method can learn safe and
optimal policies through hypothesis testing, 2) ESRL allows for different
levels of risk averse implementations tailored to the application context, and
finally, 3) we propose a way to interpret ESRL's policy at every state through
posterior distributions, and use this framework to compute off-policy value
function posteriors. We provide theoretical guarantees for our estimators and
regret bounds consistent with Posterior Sampling for RL (PSRL). Sample
efficiency of ESRL is independent of the chosen risk aversion threshold and
quality of the behavior policy.

14
The categories of this paper are: math-ph
10
The categories of this paper are: q-bio
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci
17
The categories of this paper are: q-fin
7
The categories of this paper are: hep-th
32
The categories of this paper are: atom-ph
22
The categories of this paper are: chao-dyn
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
8
The categories of this paper are: hep-ex
35
The categories of this paper are: mtrl-th
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg