Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Stochastic Shortest Path: Minimax, Parameter-Free and Towards
  Horizon-Free Regret   We study the problem of learning in the stochastic shortest path (SSP)
setting, where an agent seeks to minimize the expected cost accumulated before
reaching a goal state. We design a novel model-based algorithm EB-SSP that
carefully skews the empirical transitions and perturbs the empirical costs with
an exploration bonus to induce an optimistic SSP problem whose associated value
iteration scheme is guaranteed to converge. We prove that EB-SSP achieves the
minimax regret rate $\tilde{O}(B_{\star} \sqrt{S A K})$, where $K$ is the
number of episodes, $S$ is the number of states, $A$ is the number of actions,
and $B_{\star}$ bounds the expected cumulative cost of the optimal policy from
any state, thus closing the gap with the lower bound. Interestingly, EB-SSP
obtains this result while being parameter-free, i.e., it does not require any
prior knowledge of $B_{\star}$, nor of $T_{\star}$, which bounds the expected
time-to-goal of the optimal policy from any state. Furthermore, we illustrate
various cases (e.g., positive costs, or general costs when an order-accurate
estimate of $T_{\star}$ is available) where the regret only contains a
logarithmic dependence on $T_{\star}$, thus yielding the first (nearly)
horizon-free regret bound beyond the finite-horizon MDP setting.

22
The categories of this paper are: chao-dyn
7
The categories of this paper are: hep-th
10
The categories of this paper are: q-bio
15
The categories of this paper are: nucl-ex
4
The categories of this paper are: cond-mat
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
35
The categories of this paper are: mtrl-th
2
The categories of this paper are: math
11
The categories of this paper are: hep-lat
29
The categories of this paper are: funct-an
31
The categories of this paper are: ao-sci
34
The categories of this paper are: chem-ph
5
The categories of this paper are: gr-qc