Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Monte Carlo Rollout Policy for Recommendation Systems with Dynamic User
  Behavior   We model online recommendation systems using the hidden Markov multi-state
restless multi-armed bandit problem. To solve this we present Monte Carlo
rollout policy. We illustrate numerically that Monte Carlo rollout policy
performs better than myopic policy for arbitrary transition dynamics with no
specific structure. But, when some structure is imposed on the transition
dynamics, myopic policy performs better than Monte Carlo rollout policy.

25
The categories of this paper are: patt-sol
29
The categories of this paper are: funct-an
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
18
The categories of this paper are: econ
4
The categories of this paper are: cond-mat
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
27
The categories of this paper are: comp-gas
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
11
The categories of this paper are: hep-lat
32
The categories of this paper are: atom-ph