Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: ExTra: Transfer-guided Exploration   In this work we present a novel approach for transfer-guided exploration in
reinforcement learning that is inspired by the human tendency to leverage
experiences from similar encounters in the past while navigating a new task.
Given an optimal policy in a related task-environment, we show that its
bisimulation distance from the current task-environment gives a lower bound on
the optimal advantage of state-action pairs in the current task-environment.
Transfer-guided Exploration (ExTra) samples actions from a Softmax distribution
over these lower bounds. In this way, actions with potentially higher optimum
advantage are sampled more frequently. In our experiments on gridworld
environments, we demonstrate that given access to an optimal policy in a
related task-environment, ExTra can outperform popular domain-specific
exploration strategies viz. epsilon greedy, Model-Based Interval Estimation -
Exploration Bonus (MBIE-EB), Pursuit and Boltzmann in rate of convergence. We
further show that ExTra is robust to choices of source task and shows a
graceful degradation of performance as the dissimilarity of the source task
increases. We also demonstrate that ExTra, when used alongside traditional
exploration algorithms, improves their rate of convergence. Thus it is capable
of complementing the efficacy of traditional exploration algorithms.

3
The categories of this paper are: physics
25
The categories of this paper are: patt-sol
22
The categories of this paper are: chao-dyn
11
The categories of this paper are: hep-lat
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
17
The categories of this paper are: q-fin
5
The categories of this paper are: gr-qc
23
The categories of this paper are: solv-int
26
The categories of this paper are: bayes-an
37
The categories of this paper are: supr-con
33
The categories of this paper are: plasm-ph
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ
12
The categories of this paper are: nucl-th
31
The categories of this paper are: ao-sci