Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Diversity is All You Need: Learning Skills without a Reward Function   Intelligent creatures can explore their environments and learn useful skills
without supervision. In this paper, we propose DIAYN ('Diversity is All You
Need'), a method for learning useful skills without a reward function. Our
proposed method learns skills by maximizing an information theoretic objective
using a maximum entropy policy. On a variety of simulated robotic tasks, we
show that this simple objective results in the unsupervised emergence of
diverse skills, such as walking and jumping. In a number of reinforcement
learning benchmark environments, our method is able to learn a skill that
solves the benchmark task despite never receiving the true task reward. We show
how pretrained skills can provide a good parameter initialization for
downstream tasks, and can be composed hierarchically to solve complex, sparse
reward tasks. Our results suggest that unsupervised discovery of skills can
serve as an effective pretraining mechanism for overcoming challenges of
exploration and data efficiency in reinforcement learning.

11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
19
The categories of this paper are: eess
36
The categories of this paper are: cmp-lg
12
The categories of this paper are: nucl-th
4
The categories of this paper are: cond-mat
9
The categories of this paper are: nlin
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
35
The categories of this paper are: mtrl-th
16
The categories of this paper are: stat
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
7
The categories of this paper are: hep-th
24
The categories of this paper are: dg-ga
13
The categories of this paper are: quant-ph