Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Augmented World Models Facilitate Zero-Shot Dynamics Generalization From
  a Single Offline Environment   Reinforcement learning from large-scale offline datasets provides us with the
ability to learn policies without potentially unsafe or impractical
exploration. Significant progress has been made in the past few years in
dealing with the challenge of correcting for differing behavior between the
data collection and learned policies. However, little attention has been paid
to potentially changing dynamics when transferring a policy to the online
setting, where performance can be up to 90% reduced for existing methods. In
this paper we address this problem with Augmented World Models (AugWM). We
augment a learned dynamics model with simple transformations that seek to
capture potential changes in physical properties of the robot, leading to more
robust policies. We not only train our policy in this new setting, but also
provide it with the sampled augmentation as a context, allowing it to adapt to
changes in the environment. At test time we learn the context in a
self-supervised fashion by approximating the augmentation which corresponds to
the new environment. We rigorously evaluate our approach on over 100 different
changed dynamics settings, and show that this simple approach can significantly
improve the zero-shot generalization of a recent state-of-the-art baseline,
often achieving successful policies where the baseline fails.

34
The categories of this paper are: chem-ph
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
36
The categories of this paper are: cmp-lg
19
The categories of this paper are: eess
32
The categories of this paper are: atom-ph
3
The categories of this paper are: physics
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
25
The categories of this paper are: patt-sol
17
The categories of this paper are: q-fin
33
The categories of this paper are: plasm-ph
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
23
The categories of this paper are: solv-int
10
The categories of this paper are: q-bio