Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Cumulative Prospect Theory Meets Reinforcement Learning: Prediction and
  Control   Cumulative prospect theory (CPT) is known to model human decisions well, with
substantial empirical evidence supporting this claim. CPT works by distorting
probabilities and is more general than the classic expected utility and
coherent risk measures. We bring this idea to a risk-sensitive reinforcement
learning (RL) setting and design algorithms for both estimation and control.
The RL setting presents two particular challenges when CPT is applied:
estimating the CPT objective requires estimations of the entire distribution of
the value function and finding a randomized optimal policy. The estimation
scheme that we propose uses the empirical distribution to estimate the
CPT-value of a random variable. We then use this scheme in the inner loop of a
CPT-value optimization procedure that is based on the well-known simulation
optimization idea of simultaneous perturbation stochastic approximation (SPSA).
We provide theoretical convergence guarantees for all the proposed algorithms
and also illustrate the usefulness of CPT-based criteria in a traffic signal
control application.

21
The categories of this paper are: adap-org
14
The categories of this paper are: math-ph
25
The categories of this paper are: patt-sol
33
The categories of this paper are: plasm-ph
26
The categories of this paper are: bayes-an
11
The categories of this paper are: hep-lat
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
18
The categories of this paper are: econ
32
The categories of this paper are: atom-ph
7
The categories of this paper are: hep-th
8
The categories of this paper are: hep-ex
23
The categories of this paper are: solv-int
0
The categories of this paper are: hep-ph
30
The categories of this paper are: q-alg