Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Diffusion Approximations for Thompson Sampling   We study the behavior of Thompson sampling from the perspective of weak
convergence. In the regime where the gaps between arm means scale as
$1/\sqrt{n}$ with the time horizon $n$, we show that the dynamics of Thompson
sampling evolve according to discrete versions of SDEs and random ODEs. As $n
\to \infty$, we show that the dynamics converge weakly to solutions of the
corresponding SDEs and random ODEs. (Recently, Wager and Xu (arXiv:2101.09855)
independently proposed this regime and developed similar SDE and random ODE
approximations for Thompson sampling in the multi-armed bandit setting.) Our
weak convergence theory, which covers both multi-armed and linear bandit
settings, is developed from first principles using the Continuous Mapping
Theorem and can be directly adapted to analyze other sampling-based bandit
algorithms, for example, algorithms using the bootstrap for exploration. We
also establish an invariance principle for multi-armed bandits with gaps
scaling as $1/\sqrt{n}$ -- for Thompson sampling and related algorithms
involving posterior approximation or the bootstrap, the weak diffusion limits
are in general the same regardless of the specifics of the reward distributions
or the choice of prior. In particular, as suggested by the classical
Bernstein-von Mises normal approximation for posterior distributions, the weak
diffusion limits generally coincide with the limit for normally-distributed
rewards and priors.

22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
37
The categories of this paper are: supr-con
27
The categories of this paper are: comp-gas
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
36
The categories of this paper are: cmp-lg
5
The categories of this paper are: gr-qc
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
28
The categories of this paper are: alg-geom
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int
14
The categories of this paper are: math-ph