Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: An Asymptotically Optimal Primal-Dual Incremental Algorithm for
  Contextual Linear Bandits   In the contextual linear bandit setting, algorithms built on the optimism
principle fail to exploit the structure of the problem and have been shown to
be asymptotically suboptimal. In this paper, we follow recent approaches of
deriving asymptotically optimal algorithms from problem-dependent regret lower
bounds and we introduce a novel algorithm improving over the state-of-the-art
along multiple dimensions. We build on a reformulation of the lower bound,
where context distribution and exploration policy are decoupled, and we obtain
an algorithm robust to unbalanced context distributions. Then, using an
incremental primal-dual approach to solve the Lagrangian relaxation of the
lower bound, we obtain a scalable and computationally efficient algorithm.
Finally, we remove forced exploration and build on confidence intervals of the
optimization problem to encourage a minimum level of exploration that is better
adapted to the problem structure. We demonstrate the asymptotic optimality of
our algorithm, while providing both problem-dependent and worst-case
finite-time regret guarantees. Our bounds scale with the logarithm of the
number of arms, thus avoiding the linear dependence common in all related prior
works. Notably, we establish minimax optimality for any learning horizon in the
special case of non-contextual linear bandits. Finally, we verify that our
algorithm obtains better empirical performance than state-of-the-art baselines.

34
The categories of this paper are: chem-ph
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
36
The categories of this paper are: cmp-lg
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
21
The categories of this paper are: adap-org
2
The categories of this paper are: math
10
The categories of this paper are: q-bio
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
15
The categories of this paper are: nucl-ex
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
3
The categories of this paper are: physics
7
The categories of this paper are: hep-th