Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Active Trajectory Estimation for Partially Observed Markov Decision
  Processes via Conditional Entropy   In this paper, we consider the problem of controlling a partially observed
Markov decision process (POMDP) in order to actively estimate its state
trajectory over a fixed horizon with minimal uncertainty. We pose a novel
active smoothing problem in which the objective is to directly minimise the
smoother entropy, that is, the conditional entropy of the (joint) state
trajectory distribution of concern in fixed-interval Bayesian smoothing. Our
formulation contrasts with prior active approaches that minimise the sum of
conditional entropies of the (marginal) state estimates provided by Bayesian
filters. By establishing a novel form of the smoother entropy in terms of the
POMDP belief (or information) state, we show that our active smoothing problem
can be reformulated as a (fully observed) Markov decision process with a value
function that is concave in the belief state. The concavity of the value
function is of particular importance since it enables the approximate solution
of our active smoothing problem using piecewise-linear function approximations
in conjunction with standard POMDP solvers. We illustrate the approximate
solution of our active smoothing problem in simulation and compare its
performance to alternative approaches based on minimising marginal state
estimate uncertainties.

28
The categories of this paper are: alg-geom
26
The categories of this paper are: bayes-an
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
20
The categories of this paper are: acc-phys
25
The categories of this paper are: patt-sol
34
The categories of this paper are: chem-ph
35
The categories of this paper are: mtrl-th
37
The categories of this paper are: supr-con
16
The categories of this paper are: stat
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph
10
The categories of this paper are: q-bio
32
The categories of this paper are: atom-ph
23
The categories of this paper are: solv-int