Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: On Optimal Control of Discounted Cost Infinite-Horizon Markov Decision
  Processes Under Local State Information Structures   This paper investigates a class of optimal control problems associated with
Markov processes with local state information. The decision-maker has only
local access to a subset of a state vector information as often encountered in
decentralized control problems in multi-agent systems. Under this information
structure, part of the state vector cannot be observed. We leverage ab initio
principles and find a new form of Bellman equations to characterize the optimal
policies of the control problem under local information structures. The dynamic
programming solutions feature a mixture of dynamics associated unobservable
state components and the local state-feedback policy based on the observable
local information. We further characterize the optimal local-state feedback
policy using linear programming methods. To reduce the computational complexity
of the optimal policy, we propose an approximate algorithm based on virtual
beliefs to find a sub-optimal policy. We show the performance bounds on the
sub-optimal solution and corroborate the results with numerical case studies.

0
The categories of this paper are: hep-ph
12
The categories of this paper are: nucl-th
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
31
The categories of this paper are: ao-sci
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
23
The categories of this paper are: solv-int
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
30
The categories of this paper are: q-alg
8
The categories of this paper are: hep-ex
16
The categories of this paper are: stat
13
The categories of this paper are: quant-ph