Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Approximate information state for approximate planning and reinforcement
  learning in partially observed systems   We propose a theoretical framework for approximate planning and learning in
partially observed systems. Our framework is based on the fundamental notion of
information state. We provide two equivalent definitions of information state
-- i) a function of history which is sufficient to compute the expected reward
and predict its next value; ii) equivalently, a function of the history which
can be recursively updated and is sufficient to compute the expected reward and
predict the next observation. An information state always leads to a dynamic
programming decomposition. Our key result is to show that if a function of the
history (called approximate information state (AIS)) approximately satisfies
the properties of the information state, then there is a corresponding
approximate dynamic program. We show that the policy computed using this is
approximately optimal with bounded loss of optimality. We show that several
approximations in state, observation and action spaces in literature can be
viewed as instances of AIS. In some of these cases, we obtain tighter bounds. A
salient feature of AIS is that it can be learnt from data. We present AIS based
multi-time scale policy gradient algorithms. and detailed numerical experiments
with low, moderate and high dimensional environments.

22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
8
The categories of this paper are: hep-ex
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol
20
The categories of this paper are: acc-phys
12
The categories of this paper are: nucl-th
6
The categories of this paper are: astro-ph
14
The categories of this paper are: math-ph
17
The categories of this paper are: q-fin
23
The categories of this paper are: solv-int
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph