Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Context-aware Active Multi-Step Reinforcement Learning   Reinforcement learning has attracted great attention recently, especially
policy gradient algorithms, which have been demonstrated on challenging
decision making and control tasks. In this paper, we propose an active
multi-step TD algorithm with adaptive stepsizes to learn actor and critic.
Specifically, our model consists of two components: active stepsize learning
and adaptive multi-step TD algorithm. Firstly, we divide the time horizon into
chunks and actively select state and action inside each chunk. Then given the
selected samples, we propose the adaptive multi-step TD, which generalizes
TD($\lambda$), but adaptively switch on/off the backups from future returns of
different steps. Particularly, the adaptive multi-step TD introduces a
context-aware mechanism, here a binary classifier, which decides whether or not
to turn on its future backups based on the context changes. Thus, our model is
kind of combination of active learning and multi-step TD algorithm, which has
the capacity for learning off-policy without the need of importance sampling.
We evaluate our approach on both discrete and continuous space tasks in an
off-policy setting respectively, and demonstrate competitive results compared
to other reinforcement learning baselines.

32
The categories of this paper are: atom-ph
29
The categories of this paper are: funct-an
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
3
The categories of this paper are: physics
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
20
The categories of this paper are: acc-phys
10
The categories of this paper are: q-bio
19
The categories of this paper are: eess
12
The categories of this paper are: nucl-th
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci