Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reinforcement Learning for Slate-based Recommender Systems: A Tractable
  Decomposition and Practical Methodology   Most practical recommender systems focus on estimating immediate user
engagement without considering the long-term effects of recommendations on user
behavior. Reinforcement learning (RL) methods offer the potential to optimize
recommendations for long-term user engagement. However, since users are often
presented with slates of multiple items - which may have interacting effects on
user choice - methods are required to deal with the combinatorics of the RL
action space. In this work, we address the challenge of making slate-based
recommendations to optimize long-term value using RL. Our contributions are
three-fold. (i) We develop SLATEQ, a decomposition of value-based
temporal-difference and Q-learning that renders RL tractable with slates. Under
mild assumptions on user choice behavior, we show that the long-term value
(LTV) of a slate can be decomposed into a tractable function of its component
item-wise LTVs. (ii) We outline a methodology that leverages existing myopic
learning-based recommenders to quickly develop a recommender that handles LTV.
(iii) We demonstrate our methods in simulation, and validate the scalability of
decomposed TD-learning using SLATEQ in live experiments on YouTube.

32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
30
The categories of this paper are: q-alg
24
The categories of this paper are: dg-ga
17
The categories of this paper are: q-fin
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat
20
The categories of this paper are: acc-phys
2
The categories of this paper are: math