Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Double Reinforcement Learning for Efficient Off-Policy Evaluation in
  Markov Decision Processes   Off-policy evaluation (OPE) in reinforcement learning allows one to evaluate
novel decision policies without needing to conduct exploration, which is often
costly or otherwise infeasible. We consider for the first time the
semiparametric efficiency limits of OPE in Markov decision processes (MDPs),
where actions, rewards, and states are memoryless. We show existing OPE
estimators may fail to be efficient in this setting. We develop a new estimator
based on cross-fold estimation of $q$-functions and marginalized density
ratios, which we term double reinforcement learning (DRL). We show that DRL is
efficient when both components are estimated at fourth-root rates and is also
doubly robust when only one component is consistent. We investigate these
properties empirically and demonstrate the performance benefits due to
harnessing memorylessness.

22
The categories of this paper are: chao-dyn
35
The categories of this paper are: mtrl-th
19
The categories of this paper are: eess
0
The categories of this paper are: hep-ph
11
The categories of this paper are: hep-lat
33
The categories of this paper are: plasm-ph
3
The categories of this paper are: physics
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin
7
The categories of this paper are: hep-th
29
The categories of this paper are: funct-an
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
30
The categories of this paper are: q-alg