Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning to Reweight Imaginary Transitions for Model-Based Reinforcement
  Learning   Model-based reinforcement learning (RL) is more sample efficient than
model-free RL by using imaginary trajectories generated by the learned dynamics
model. When the model is inaccurate or biased, imaginary trajectories may be
deleterious for training the action-value and policy functions. To alleviate
such problem, this paper proposes to adaptively reweight the imaginary
transitions, so as to reduce the negative effects of poorly generated
trajectories. More specifically, we evaluate the effect of an imaginary
transition by calculating the change of the loss computed on the real samples
when we use the transition to train the action-value and policy functions.
Based on this evaluation criterion, we construct the idea of reweighting each
imaginary transition by a well-designed meta-gradient algorithm. Extensive
experimental results demonstrate that our method outperforms state-of-the-art
model-based and model-free RL algorithms on multiple tasks. Visualization of
our changing weights further validates the necessity of utilizing reweight
scheme.

34
The categories of this paper are: chem-ph
11
The categories of this paper are: hep-lat
35
The categories of this paper are: mtrl-th
18
The categories of this paper are: econ
16
The categories of this paper are: stat
12
The categories of this paper are: nucl-th
13
The categories of this paper are: quant-ph
21
The categories of this paper are: adap-org
6
The categories of this paper are: astro-ph
7
The categories of this paper are: hep-th
5
The categories of this paper are: gr-qc
4
The categories of this paper are: cond-mat
15
The categories of this paper are: nucl-ex
0
The categories of this paper are: hep-ph
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci