Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Qualitative Controller Synthesis for Consumption Markov Decision
  Processes   Consumption Markov Decision Processes (CMDPs) are probabilistic
decision-making models of resource-constrained systems. In a CMDP, the
controller possesses a certain amount of a critical resource, such as electric
power. Each action of the controller can consume some amount of the resource.
Resource replenishment is only possible in special reload states, in which the
resource level can be reloaded up to the full capacity of the system. The task
of the controller is to prevent resource exhaustion, i.e. ensure that the
available amount of the resource stays non-negative, while ensuring an
additional linear-time property. We study the complexity of strategy synthesis
in consumption MDPs with almost-sure B\"uchi objectives. We show that the
problem can be solved in polynomial time. We implement our algorithm and show
that it can efficiently solve CMDPs modelling real-world scenarios.

37
The categories of this paper are: supr-con
3
The categories of this paper are: physics
18
The categories of this paper are: econ
0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
23
The categories of this paper are: solv-int
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
14
The categories of this paper are: math-ph
16
The categories of this paper are: stat
22
The categories of this paper are: chao-dyn
30
The categories of this paper are: q-alg
11
The categories of this paper are: hep-lat