Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: TOMA: Topological Map Abstraction for Reinforcement Learning   Animals are able to discover the topological map (graph) of surrounding
environment, which will be used for navigation. Inspired by this biological
phenomenon, researchers have recently proposed to generate graph representation
for Markov decision process (MDP) and use such graphs for planning in
reinforcement learning (RL). However, existing graph generation methods suffer
from many drawbacks. One drawback is that existing methods do not learn an
abstraction for graphs, which results in high memory and computation cost. This
drawback also makes generated graph non-robust, which degrades the planning
performance. Another drawback is that existing methods cannot be used for
facilitating exploration which is important in RL. In this paper, we propose a
new method, called topological map abstraction (TOMA), for graph generation.
TOMA can generate an abstract graph representation for MDP, which costs much
less memory and computation cost than existing methods. Furthermore, TOMA can
be used for facilitating exploration. In particular, we propose planning to
explore, in which TOMA is used to accelerate exploration by guiding the agent
towards unexplored states. A novel experience replay module called vertex
memory is also proposed to improve exploration performance. Experimental
results show that TOMA can outperform existing methods to achieve the
state-of-the-art performance.

36
The categories of this paper are: cmp-lg
0
The categories of this paper are: hep-ph
21
The categories of this paper are: adap-org
20
The categories of this paper are: acc-phys
4
The categories of this paper are: cond-mat
29
The categories of this paper are: funct-an
8
The categories of this paper are: hep-ex
32
The categories of this paper are: atom-ph
14
The categories of this paper are: math-ph
9
The categories of this paper are: nlin
5
The categories of this paper are: gr-qc
7
The categories of this paper are: hep-th
30
The categories of this paper are: q-alg
33
The categories of this paper are: plasm-ph
15
The categories of this paper are: nucl-ex
11
The categories of this paper are: hep-lat