Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reinforcement Learning of Risk-Constrained Policies in Markov Decision
  Processes   Markov decision processes (MDPs) are the defacto frame-work for sequential
decision making in the presence ofstochastic uncertainty. A classical
optimization criterion forMDPs is to maximize the expected discounted-sum
pay-off, which ignores low probability catastrophic events withhighly negative
impact on the system. On the other hand,risk-averse policies require the
probability of undesirableevents to be below a given threshold, but they do not
accountfor optimization of the expected payoff. We consider MDPswith
discounted-sum payoff with failure states which repre-sent catastrophic
outcomes. The objective of risk-constrainedplanning is to maximize the expected
discounted-sum payoffamong risk-averse policies that ensure the probability to
en-counter a failure state is below a desired threshold. Our maincontribution
is an efficient risk-constrained planning algo-rithm that combines UCT-like
search with a predictor learnedthrough interaction with the MDP (in the style
of AlphaZero)and with a risk-constrained action selection via linear
pro-gramming. We demonstrate the effectiveness of our approachwith experiments
on classical MDPs from the literature, in-cluding benchmarks with an order of
10^6 states.

16
The categories of this paper are: stat
6
The categories of this paper are: astro-ph
26
The categories of this paper are: bayes-an
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
35
The categories of this paper are: mtrl-th
19
The categories of this paper are: eess
5
The categories of this paper are: gr-qc
13
The categories of this paper are: quant-ph
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg
27
The categories of this paper are: comp-gas
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio