Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Learning of Long-Horizon Sparse-Reward Robotic Manipulator Tasks with
  Base Controllers   Deep Reinforcement Learning (DRL) enables robots to perform some intelligent
tasks end-to-end. However, there are still many challenges for long-horizon
sparse-reward robotic manipulator tasks. On the one hand, a sparse-reward
setting causes exploration inefficient. On the other hand, exploration using
physical robots is of high cost and unsafe. In this paper, we propose a method
of learning long-horizon sparse-reward tasks utilizing one or more existing
traditional controllers named base controllers in this paper. Built upon Deep
Deterministic Policy Gradients (DDPG), our algorithm incorporates the existing
base controllers into stages of exploration, value learning, and policy update.
Furthermore, we present a straightforward way of synthesizing different base
controllers to integrate their strengths. Through experiments ranging from
stacking blocks to cups, it is demonstrated that the learned state-based or
image-based policies steadily outperform base controllers. Compared to previous
works of learning from demonstrations, our method improves sample efficiency by
orders of magnitude and improves the performance. Overall, our method bears the
potential of leveraging existing industrial robot manipulation systems to build
more flexible and intelligent controllers.

29
The categories of this paper are: funct-an
22
The categories of this paper are: chao-dyn
23
The categories of this paper are: solv-int
5
The categories of this paper are: gr-qc
11
The categories of this paper are: hep-lat
24
The categories of this paper are: dg-ga
16
The categories of this paper are: stat
35
The categories of this paper are: mtrl-th
34
The categories of this paper are: chem-ph
8
The categories of this paper are: hep-ex
19
The categories of this paper are: eess
37
The categories of this paper are: supr-con
9
The categories of this paper are: nlin
30
The categories of this paper are: q-alg
21
The categories of this paper are: adap-org
31
The categories of this paper are: ao-sci