Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Supervised Policy Update for Deep Reinforcement Learning   We propose a new sample-efficient methodology, called Supervised Policy
Update (SPU), for deep reinforcement learning. Starting with data generated by
the current policy, SPU formulates and solves a constrained optimization
problem in the non-parameterized proximal policy space. Using supervised
regression, it then converts the optimal non-parameterized policy to a
parameterized policy, from which it draws new samples. The methodology is
general in that it applies to both discrete and continuous action spaces, and
can handle a wide variety of proximity constraints for the non-parameterized
optimization problem. We show how the Natural Policy Gradient and Trust Region
Policy Optimization (NPG/TRPO) problems, and the Proximal Policy Optimization
(PPO) problem can be addressed by this methodology. The SPU implementation is
much simpler than TRPO. In terms of sample efficiency, our extensive
experiments show SPU outperforms TRPO in Mujoco simulated robotic tasks and
outperforms PPO in Atari video game tasks.

35
The categories of this paper are: mtrl-th
5
The categories of this paper are: gr-qc
21
The categories of this paper are: adap-org
29
The categories of this paper are: funct-an
22
The categories of this paper are: chao-dyn
24
The categories of this paper are: dg-ga
34
The categories of this paper are: chem-ph
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con
36
The categories of this paper are: cmp-lg
26
The categories of this paper are: bayes-an
19
The categories of this paper are: eess
2
The categories of this paper are: math
3
The categories of this paper are: physics
6
The categories of this paper are: astro-ph
18
The categories of this paper are: econ