Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Computing Policies That Account For The Effects Of Human Agent
  Uncertainty During Execution In Markov Decision Processes   When humans are given a policy to execute, there can be policy execution
errors and deviations in policy if there is uncertainty in identifying a state.
This can happen due to the human agent's cognitive limitations and/or
perceptual errors. So an algorithm that computes a policy for a human to
execute ought to consider these effects in its computations. An optimal Markov
Decision Process (MDP) policy that is poorly executed (because of a human
agent) maybe much worse than another policy that is suboptimal in the MDP, but
considers the human-agent's execution behavior. In this paper we consider two
problems that arise from state uncertainty; these are erroneous
state-inference, and extra-sensing actions that a person might take as a result
of their uncertainty. We present a framework to model the human agent's
behavior with respect to state uncertainty, and can be used to compute MDP
policies that accounts for these problems. This is followed by a hill climbing
algorithm to search for good policies given our model of the human agent. We
also present a branch and bound algorithm which can find the optimal policy for
such problems. We show experimental results in a Gridworld domain, and
warehouse-worker domain. Finally, we present human-subject studies that support
our human model assumptions.

20
The categories of this paper are: acc-phys
9
The categories of this paper are: nlin
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
10
The categories of this paper are: q-bio
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
34
The categories of this paper are: chem-ph
36
The categories of this paper are: cmp-lg