Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: An Analysis of the Value of Information when Exploring Stochastic,
  Discrete Multi-Armed Bandits   In this paper, we propose an information-theoretic exploration strategy for
stochastic, discrete multi-armed bandits that achieves optimal regret. Our
strategy is based on the value of information criterion. This criterion
measures the trade-off between policy information and obtainable rewards. High
amounts of policy information are associated with exploration-dominant searches
of the space and yield high rewards. Low amounts of policy information favor
the exploitation of existing knowledge. Information, in this criterion, is
quantified by a parameter that can be varied during search. We demonstrate that
a simulated-annealing-like update of this parameter, with a sufficiently fast
cooling schedule, leads to an optimal regret that is logarithmic with respect
to the number of episodes.

27
The categories of this paper are: comp-gas
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
0
The categories of this paper are: hep-ph
32
The categories of this paper are: atom-ph
34
The categories of this paper are: chem-ph
14
The categories of this paper are: math-ph
7
The categories of this paper are: hep-th
28
The categories of this paper are: alg-geom
31
The categories of this paper are: ao-sci
11
The categories of this paper are: hep-lat
10
The categories of this paper are: q-bio
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph