Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Generalized Hidden Parameter MDPs Transferable Model-based RL in a
  Handful of Trials   There is broad interest in creating RL agents that can solve many (related)
tasks and adapt to new tasks and environments after initial training.
Model-based RL leverages learned surrogate models that describe dynamics and
rewards of individual tasks, such that planning in a good surrogate can lead to
good control of the true system. Rather than solving each task individually
from scratch, hierarchical models can exploit the fact that tasks are often
related by (unobserved) causal factors of variation in order to achieve
efficient generalization, as in learning how the mass of an item affects the
force required to lift it can generalize to previously unobserved masses. We
propose Generalized Hidden Parameter MDPs (GHP-MDPs) that describe a family of
MDPs where both dynamics and reward can change as a function of hidden
parameters that vary across tasks. The GHP-MDP augments model-based RL with
latent variables that capture these hidden parameters, facilitating transfer
across tasks. We also explore a variant of the model that incorporates explicit
latent structure mirroring the causal factors of variation across tasks (for
instance: agent properties, environmental factors, and goals). We
experimentally demonstrate state-of-the-art performance and sample-efficiency
on a new challenging MuJoCo task using reward and dynamics latent spaces, while
beating a previous state-of-the-art baseline with $>10\times$ less data. Using
test-time inference of the latent variables, our approach generalizes in a
single episode to novel combinations of dynamics and reward, and to novel
rewards.

2
The categories of this paper are: math
0
The categories of this paper are: hep-ph
14
The categories of this paper are: math-ph
12
The categories of this paper are: nucl-th
24
The categories of this paper are: dg-ga
26
The categories of this paper are: bayes-an
28
The categories of this paper are: alg-geom
11
The categories of this paper are: hep-lat
31
The categories of this paper are: ao-sci
29
The categories of this paper are: funct-an
10
The categories of this paper are: q-bio
30
The categories of this paper are: q-alg
4
The categories of this paper are: cond-mat
15
The categories of this paper are: nucl-ex
6
The categories of this paper are: astro-ph
17
The categories of this paper are: q-fin