Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Proximal Policy Optimization with Mixed Distributed Training   Instability and slowness are two main problems in deep reinforcement
learning. Even if proximal policy optimization (PPO) is the state of the art,
it still suffers from these two problems. We introduce an improved algorithm
based on proximal policy optimization, mixed distributed proximal policy
optimization (MDPPO), and show that it can accelerate and stabilize the
training process. In our algorithm, multiple different policies train
simultaneously and each of them controls several identical agents that interact
with environments. Actions are sampled by each policy separately as usual, but
the trajectories for the training process are collected from all agents,
instead of only one policy. We find that if we choose some auxiliary
trajectories elaborately to train policies, the algorithm will be more stable
and quicker to converge especially in the environments with sparse rewards.

14
The categories of this paper are: math-ph
20
The categories of this paper are: acc-phys
35
The categories of this paper are: mtrl-th
30
The categories of this paper are: q-alg
18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
29
The categories of this paper are: funct-an
16
The categories of this paper are: stat
37
The categories of this paper are: supr-con
7
The categories of this paper are: hep-th
12
The categories of this paper are: nucl-th
15
The categories of this paper are: nucl-ex
5
The categories of this paper are: gr-qc
36
The categories of this paper are: cmp-lg
28
The categories of this paper are: alg-geom
32
The categories of this paper are: atom-ph