Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Finite Model Approximations for Partially Observed Markov Decision
  Processes with Discounted Cost   We consider finite model approximations of discrete-time partially observed
Markov decision processes (POMDPs) under the discounted cost criterion. After
converting the original partially observed stochastic control problem to a
fully observed one on the belief space, the finite models are obtained through
the uniform quantization of the state and action spaces of the belief space
Markov decision process (MDP). Under mild assumptions on the components of the
original model, it is established that the policies obtained from these finite
models are nearly optimal for the belief space MDP, and so, for the original
partially observed problem. The assumptions essentially require that the belief
space MDP satisfies a mild weak continuity condition. We provide examples and
introduce explicit approximation procedures for the quantization of the set of
probability measures on the state space of POMDP (i.e., belief space).

34
The categories of this paper are: chem-ph
31
The categories of this paper are: ao-sci
21
The categories of this paper are: adap-org
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
8
The categories of this paper are: hep-ex
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
36
The categories of this paper are: cmp-lg
30
The categories of this paper are: q-alg
35
The categories of this paper are: mtrl-th
26
The categories of this paper are: bayes-an
29
The categories of this paper are: funct-an
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat