Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Finite Horizon Q-learning: Stability, Convergence, Simulations and an
  application on Smart Grids   Q-learning is a popular reinforcement learning algorithm. This algorithm has
however been studied and analysed mainly in the infinite horizon setting. There
are several important applications which can be modeled in the framework of
finite horizon Markov decision processes. We develop a version of Q-learning
algorithm for finite horizon Markov decision processes (MDP) and provide a full
proof of its stability and convergence. Our analysis of stability and
convergence of finite horizon Q-learning is based entirely on the ordinary
differential equations (O.D.E) method. We also demonstrate the performance of
our algorithm on a setting of random MDP as well as on an application on smart
grids.

28
The categories of this paper are: alg-geom
5
The categories of this paper are: gr-qc
23
The categories of this paper are: solv-int
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
26
The categories of this paper are: bayes-an
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
3
The categories of this paper are: physics
22
The categories of this paper are: chao-dyn
10
The categories of this paper are: q-bio
17
The categories of this paper are: q-fin