Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Modeling and Optimizing Resource Allocation Decisions through
  Multi-model Markov Decision Processes with Capacity Constraints   This paper proposes a new formulation for the dynamic resource allocation
problem, which converts the traditional MDP model with known parameters and no
capacity constraints to a new model with uncertain parameters and a resource
capacity constraint. Our motivating example comes from a medical resource
allocation problem: patients with multiple chronic diseases can be provided
either normal or special care, where the capacity of special care is limited
due to financial or human resources. In such systems, it is difficult, if not
impossible, to generate good estimates for the evolution of health for each
patient. We formulate the problem as a two-stage stochastic integer program.
However, it becomes easily intractable in larger instances of the problem for
which we propose and test a parallel approximate dynamic programming algorithm.
We show that commercial solvers are not capable of solving the problem
instances with a large number of scenarios. Nevertheless, the proposed
algorithm provides a solution in seconds even for very large problem instances.
In our computational experiments, it finds the optimal solution for $42.86\%$
of the instances. On aggregate, it achieves $0.073\%$ mean gap value. Finally,
we estimate the value of our contribution for different realizations of the
parameters. Our findings show that there is a significant amount of additional
utility contributed by our model.

20
The categories of this paper are: acc-phys
22
The categories of this paper are: chao-dyn
1
The categories of this paper are: cs
3
The categories of this paper are: physics
32
The categories of this paper are: atom-ph
16
The categories of this paper are: stat
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
9
The categories of this paper are: nlin
35
The categories of this paper are: mtrl-th
6
The categories of this paper are: astro-ph
21
The categories of this paper are: adap-org
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin