Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Rotting bandits are not harder than stochastic ones   In stochastic multi-armed bandits, the reward distribution of each arm is
assumed to be stationary. This assumption is often violated in practice (e.g.,
in recommendation systems), where the reward of an arm may change whenever is
selected, i.e., rested bandit setting. In this paper, we consider the
non-parametric rotting bandit setting, where rewards can only decrease. We
introduce the filtering on expanding window average (FEWA) algorithm that
constructs moving averages of increasing windows to identify arms that are more
likely to return high rewards when pulled once more. We prove that for an
unknown horizon $T$, and without any knowledge on the decreasing behavior of
the $K$ arms, FEWA achieves problem-dependent regret bound of
$\widetilde{\mathcal{O}}(\log{(KT)}),$ and a problem-independent one of
$\widetilde{\mathcal{O}}(\sqrt{KT})$. Our result substantially improves over
the algorithm of Levine et al. (2017), which suffers regret
$\widetilde{\mathcal{O}}(K^{1/3}T^{2/3})$. FEWA also matches known bounds for
the stochastic bandit setting, thus showing that the rotting bandits are not
harder. Finally, we report simulations confirming the theoretical improvements
of FEWA.

30
The categories of this paper are: q-alg
13
The categories of this paper are: quant-ph
12
The categories of this paper are: nucl-th
22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
9
The categories of this paper are: nlin
25
The categories of this paper are: patt-sol
18
The categories of this paper are: econ
6
The categories of this paper are: astro-ph
11
The categories of this paper are: hep-lat
27
The categories of this paper are: comp-gas
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
26
The categories of this paper are: bayes-an