Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Non-Linear Reinforcement Learning in Large Action Spaces: Structural
  Conditions and Sample-efficiency of Posterior Sampling   Provably sample-efficient Reinforcement Learning (RL) with rich observations
and function approximation has witnessed tremendous recent progress,
particularly when the underlying function approximators are linear. In this
linear regime, computationally and statistically efficient methods exist where
the potentially infinite state and action spaces can be captured through a
known feature embedding, with the sample complexity scaling with the
(intrinsic) dimension of these features. When the action space is finite,
significantly more sophisticated results allow non-linear function
approximation under appropriate structural constraints on the underlying RL
problem, permitting for instance, the learning of good features instead of
assuming access to them. In this work, we present the first result for
non-linear function approximation which holds for general action spaces under a
linear embeddability condition, which generalizes all linear and finite action
settings. We design a novel optimistic posterior sampling strategy, TS^3 for
such problems, and show worst case sample complexity guarantees that scale with
a rank parameter of the RL problem, the linear embedding dimension introduced
in this work and standard measures of the function class complexity.

7
The categories of this paper are: hep-th
17
The categories of this paper are: q-fin
31
The categories of this paper are: ao-sci
26
The categories of this paper are: bayes-an
25
The categories of this paper are: patt-sol
8
The categories of this paper are: hep-ex
22
The categories of this paper are: chao-dyn
37
The categories of this paper are: supr-con
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
34
The categories of this paper are: chem-ph
13
The categories of this paper are: quant-ph
33
The categories of this paper are: plasm-ph
14
The categories of this paper are: math-ph
28
The categories of this paper are: alg-geom
35
The categories of this paper are: mtrl-th