Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Demonstration-efficient Inverse Reinforcement Learning in Procedurally
  Generated Environments   Deep Reinforcement Learning achieves very good results in domains where
reward functions can be manually engineered. At the same time, there is growing
interest within the community in using games based on Procedurally Content
Generation (PCG) as benchmark environments since this type of environment is
perfect for studying overfitting and generalization of agents under domain
shift. Inverse Reinforcement Learning (IRL) can instead extrapolate reward
functions from expert demonstrations, with good results even on
high-dimensional problems, however there are no examples of applying these
techniques to procedurally-generated environments. This is mostly due to the
number of demonstrations needed to find a good reward model. We propose a
technique based on Adversarial Inverse Reinforcement Learning which can
significantly decrease the need for expert demonstrations in PCG games. Through
the use of an environment with a limited set of initial seed levels, plus some
modifications to stabilize training, we show that our approach, DE-AIRL, is
demonstration-efficient and still able to extrapolate reward functions which
generalize to the fully procedural domain. We demonstrate the effectiveness of
our technique on two procedural environments, MiniGrid and DeepCrawl, for a
variety of tasks.

19
The categories of this paper are: eess
20
The categories of this paper are: acc-phys
36
The categories of this paper are: cmp-lg
9
The categories of this paper are: nlin
10
The categories of this paper are: q-bio
23
The categories of this paper are: solv-int
21
The categories of this paper are: adap-org
0
The categories of this paper are: hep-ph
37
The categories of this paper are: supr-con
32
The categories of this paper are: atom-ph
13
The categories of this paper are: quant-ph
16
The categories of this paper are: stat
27
The categories of this paper are: comp-gas
15
The categories of this paper are: nucl-ex
7
The categories of this paper are: hep-th
33
The categories of this paper are: plasm-ph