Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Q($\lambda$) with Off-Policy Corrections   We propose and analyze an alternate approach to off-policy multi-step
temporal difference learning, in which off-policy returns are corrected with
the current Q-function in terms of rewards, rather than with the target policy
in terms of transition probabilities. We prove that such approximate
corrections are sufficient for off-policy convergence both in policy evaluation
and control, provided certain conditions. These conditions relate the distance
between the target and behavior policies, the eligibility trace parameter and
the discount factor, and formalize an underlying tradeoff in off-policy
TD($\lambda$). We illustrate this theoretical relationship empirically on a
continuous-state control task.

7
The categories of this paper are: hep-th
3
The categories of this paper are: physics
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
14
The categories of this paper are: math-ph
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
35
The categories of this paper are: mtrl-th
33
The categories of this paper are: plasm-ph
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
2
The categories of this paper are: math
24
The categories of this paper are: dg-ga
9
The categories of this paper are: nlin