Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Online Attentive Kernel-Based Temporal Difference Learning   With rising uncertainty in the real world, online Reinforcement Learning (RL)
has been receiving increasing attention due to its fast learning capability and
improving data efficiency. However, online RL often suffers from complex Value
Function Approximation (VFA) and catastrophic interference, creating difficulty
for the deep neural network to be applied to an online RL algorithm in a fully
online setting. Therefore, a simpler and more adaptive approach is introduced
to evaluate value function with the kernel-based model. Sparse representations
are superior at handling interference, indicating that competitive sparse
representations should be learnable, non-prior, non-truncated and explicit when
compared with current sparse representation methods. Moreover, in learning
sparse representations, attention mechanisms are utilized to represent the
degree of sparsification, and a smooth attentive function is introduced into
the kernel-based VFA. In this paper, we propose an Online Attentive
Kernel-Based Temporal Difference (OAKTD) algorithm using two-timescale
optimization and provide convergence analysis of our proposed algorithm.
Experimental evaluations showed that OAKTD outperformed several Online
Kernel-based Temporal Difference (OKTD) learning algorithms in addition to the
Temporal Difference (TD) learning algorithm with Tile Coding on public Mountain
Car, Acrobot, CartPole and Puddle World tasks.

3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
15
The categories of this paper are: nucl-ex
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
26
The categories of this paper are: bayes-an
33
The categories of this paper are: plasm-ph
34
The categories of this paper are: chem-ph
22
The categories of this paper are: chao-dyn
31
The categories of this paper are: ao-sci
9
The categories of this paper are: nlin
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess