Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Off-policy Confidence Sequences   We develop confidence bounds that hold uniformly over time for off-policy
evaluation in the contextual bandit setting. These confidence sequences are
based on recent ideas from martingale analysis and are non-asymptotic,
non-parametric, and valid at arbitrary stopping times. We provide algorithms
for computing these confidence sequences that strike a good balance between
computational and statistical efficiency. We empirically demonstrate the
tightness of our approach in terms of failure probability and width and apply
it to the "gated deployment" problem of safely upgrading a production
contextual bandit system.

12
The categories of this paper are: nucl-th
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
6
The categories of this paper are: astro-ph
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
7
The categories of this paper are: hep-th
34
The categories of this paper are: chem-ph
24
The categories of this paper are: dg-ga