Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: PNS: Population-Guided Novelty Search for Reinforcement Learning in Hard
  Exploration Environments   Reinforcement Learning (RL) has made remarkable achievements, but it still
suffers from inadequate exploration strategies, sparse reward signals, and
deceptive reward functions. To alleviate these problems, a Population-guided
Novelty Search (PNS) parallel learning method is proposed in this paper. In
PNS, the population is divided into multiple sub-populations, each of which has
one chief agent and several exploring agents. The chief agent evaluates the
policies learned by exploring agents and shares the optimal policy with all
sub-populations. The exploring agents learn their policies in collaboration
with the guidance of the optimal policy and, simultaneously, upload their
policies to the chief agent. To balance exploration and exploitation, the
Novelty Search (NS) is employed in every chief agent to encourage policies with
high novelty while maximizing per-episode performance. We apply PNS to the twin
delayed deep deterministic (TD3) policy gradient algorithm. The effectiveness
of PNS to promote exploration and improve performance in continuous control
domains is demonstrated in the experimental section. Notably, PNS-TD3 achieves
rewards that far exceed the SOTA methods in environments with sparse or delayed
reward signals. We also demonstrate that PNS enables robotic agents to learn
control policies directly from pixels for sparse-reward manipulation in both
simulated and real-world settings.

18
The categories of this paper are: econ
33
The categories of this paper are: plasm-ph
7
The categories of this paper are: hep-th
37
The categories of this paper are: supr-con
5
The categories of this paper are: gr-qc
10
The categories of this paper are: q-bio
29
The categories of this paper are: funct-an
14
The categories of this paper are: math-ph
0
The categories of this paper are: hep-ph
34
The categories of this paper are: chem-ph
27
The categories of this paper are: comp-gas
31
The categories of this paper are: ao-sci
22
The categories of this paper are: chao-dyn
17
The categories of this paper are: q-fin
16
The categories of this paper are: stat
19
The categories of this paper are: eess