Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Hierarchical Policy Learning is Sensitive to Goal Space Design   Hierarchy in reinforcement learning agents allows for control at multiple
time scales yielding improved sample efficiency, the ability to deal with long
time horizons and transferability of sub-policies to tasks outside the training
distribution. It is often implemented as a master policy providing goals to a
sub-policy. Ideally, we would like the goal-spaces to be learned, however,
properties of optimal goal spaces still remain unknown and consequently there
is no method yet to learn optimal goal spaces. Motivated by this, we
systematically analyze how various modifications to the ground-truth goal-space
affect learning in hierarchical models with the aim of identifying important
properties of optimal goal spaces. Our results show that, while rotation of
ground-truth goal spaces and noise had no effect, having additional unnecessary
factors significantly impaired learning in hierarchical models.

22
The categories of this paper are: chao-dyn
4
The categories of this paper are: cond-mat
33
The categories of this paper are: plasm-ph
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
21
The categories of this paper are: adap-org
7
The categories of this paper are: hep-th
0
The categories of this paper are: hep-ph
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
13
The categories of this paper are: quant-ph
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas