Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Online Multi-Armed Bandit   We introduce a novel variant of the multi-armed bandit problem, in which
bandits are streamed one at a time to the player, and at each point, the player
can either choose to pull the current bandit or move on to the next bandit.
Once a player has moved on from a bandit, they may never visit it again, which
is a crucial difference between our problem and classic multi-armed bandit
problems. In this online context, we study Bernoulli bandits (bandits with
payout Ber($p_i$) for some underlying mean $p_i$) with underlying means drawn
i.i.d. from various distributions, including the uniform distribution, and in
general, all distributions that have a CDF satisfying certain differentiability
conditions near zero. In all cases, we suggest several strategies and
investigate their expected performance. Furthermore, we bound the performance
of any optimal strategy and show that the strategies we have suggested are
indeed optimal up to a constant factor. We also investigate the case where the
distribution from which the underlying means are drawn is not known ahead of
time. We again, are able to suggest algorithms that are optimal up to a
constant factor for this case, given certain mild conditions on the universe of
distributions.

7
The categories of this paper are: hep-th
20
The categories of this paper are: acc-phys
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin
13
The categories of this paper are: quant-ph
36
The categories of this paper are: cmp-lg
31
The categories of this paper are: ao-sci
37
The categories of this paper are: supr-con
14
The categories of this paper are: math-ph
2
The categories of this paper are: math
16
The categories of this paper are: stat
3
The categories of this paper are: physics
0
The categories of this paper are: hep-ph
22
The categories of this paper are: chao-dyn
26
The categories of this paper are: bayes-an
8
The categories of this paper are: hep-ex