Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Provably Efficient Reinforcement Learning with Linear Function
  Approximation   Modern Reinforcement Learning (RL) is commonly applied to practical problems
with an enormous number of states, where function approximation must be
deployed to approximate either the value function or the policy. The
introduction of function approximation raises a fundamental set of challenges
involving computational and statistical efficiency, especially given the need
to manage the exploration/exploitation tradeoff. As a result, a core RL
question remains open: how can we design provably efficient RL algorithms that
incorporate function approximation? This question persists even in a basic
setting with linear dynamics and linear rewards, for which only linear function
approximation is needed.
  This paper presents the first provable RL algorithm with both polynomial
runtime and polynomial sample complexity in this linear setting, without
requiring a "simulator" or additional assumptions. Concretely, we prove that an
optimistic modification of Least-Squares Value Iteration (LSVI)---a classical
algorithm frequently studied in the linear setting---achieves
$\tilde{\mathcal{O}}(\sqrt{d^3H^3T})$ regret, where $d$ is the ambient
dimension of feature space, $H$ is the length of each episode, and $T$ is the
total number of steps. Importantly, such regret is independent of the number of
states and actions.

15
The categories of this paper are: nucl-ex
34
The categories of this paper are: chem-ph
18
The categories of this paper are: econ
25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
23
The categories of this paper are: solv-int
13
The categories of this paper are: quant-ph
3
The categories of this paper are: physics
17
The categories of this paper are: q-fin
19
The categories of this paper are: eess
11
The categories of this paper are: hep-lat
28
The categories of this paper are: alg-geom
9
The categories of this paper are: nlin
31
The categories of this paper are: ao-sci