Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Scenario-Based Verification of Uncertain MDPs   We consider Markov decision processes (MDPs) in which the transition
probabilities and rewards belong to an uncertainty set parametrized by a
collection of random variables. The probability distributions for these random
parameters are unknown. The problem is to compute the probability to satisfy a
temporal logic specification within any MDP that corresponds to a sample from
these unknown distributions. In general, this problem is undecidable, and we
resort to techniques from so-called scenario optimization. Based on a finite
number of samples of the uncertain parameters, each of which induces an MDP,
the proposed method estimates the probability of satisfying the specification
by solving a finite-dimensional convex optimization problem. The number of
samples required to obtain a high confidence on this estimate is independent
from the number of states and the number of random parameters. Experiments on a
large set of benchmarks show that a few thousand samples suffice to obtain
high-quality confidence bounds with a high probability.

20
The categories of this paper are: acc-phys
18
The categories of this paper are: econ
30
The categories of this paper are: q-alg
34
The categories of this paper are: chem-ph
10
The categories of this paper are: q-bio
0
The categories of this paper are: hep-ph
17
The categories of this paper are: q-fin
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
23
The categories of this paper are: solv-int
35
The categories of this paper are: mtrl-th
28
The categories of this paper are: alg-geom
7
The categories of this paper are: hep-th
22
The categories of this paper are: chao-dyn
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con