Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Adaptive Multi-Goal Exploration   We introduce a generic strategy for provably efficient multi-goal
exploration. It relies on AdaGoal, a novel goal selection scheme that leverages
a measure of uncertainty in reaching states to adaptively target goals that are
neither too difficult nor too easy. We show how AdaGoal can be used to tackle
the objective of learning an $\epsilon$-optimal goal-conditioned policy for the
(initially unknown) set of goal states that are reachable within $L$ steps in
expectation from a reference state $s_0$ in a reward-free Markov decision
process. In the tabular case with $S$ states and $A$ actions, our algorithm
requires $\tilde{O}(L^3 S A \epsilon^{-2})$ exploration steps, which is nearly
minimax optimal. We also readily instantiate AdaGoal in linear mixture Markov
decision processes, yielding the first goal-oriented PAC guarantee with linear
function approximation. Beyond its strong theoretical guarantees, we anchor
AdaGoal in goal-conditioned deep reinforcement learning, both conceptually and
empirically, by connecting its idea of selecting "uncertain" goals to
maximizing value ensemble disagreement.

27
The categories of this paper are: comp-gas
6
The categories of this paper are: astro-ph
31
The categories of this paper are: ao-sci
0
The categories of this paper are: hep-ph
25
The categories of this paper are: patt-sol
4
The categories of this paper are: cond-mat
15
The categories of this paper are: nucl-ex
36
The categories of this paper are: cmp-lg
32
The categories of this paper are: atom-ph
21
The categories of this paper are: adap-org
17
The categories of this paper are: q-fin
14
The categories of this paper are: math-ph
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
13
The categories of this paper are: quant-ph
7
The categories of this paper are: hep-th