Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Computing monotone policies for Markov decision processes: a
  nearly-isotonic penalty approach   This paper discusses algorithms for solving Markov decision processes (MDPs)
that have monotone optimal policies. We propose a two-stage alternating convex
optimization scheme that can accelerate the search for an optimal policy by
exploiting the monotone property. The first stage is a linear program
formulated in terms of the joint state-action probabilities. The second stage
is a regularized problem formulated in terms of the conditional probabilities
of actions given states. The regularization uses techniques from
nearly-isotonic regression. While a variety of iterative method can be used in
the first formulation of the problem, we show in numerical simulations that, in
particular, the alternating method of multipliers (ADMM) can be significantly
accelerated using the regularization step.

27
The categories of this paper are: comp-gas
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
30
The categories of this paper are: q-alg
26
The categories of this paper are: bayes-an
7
The categories of this paper are: hep-th
4
The categories of this paper are: cond-mat
32
The categories of this paper are: atom-ph
28
The categories of this paper are: alg-geom
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
6
The categories of this paper are: astro-ph
19
The categories of this paper are: eess
17
The categories of this paper are: q-fin
15
The categories of this paper are: nucl-ex