Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Reinforcement Learning with Evolutionary Trajectory Generator: A General
  Approach for Quadrupedal Locomotion   Recently reinforcement learning (RL) has emerged as a promising approach for
quadrupedal locomotion, which can save the manual effort in conventional
approaches such as designing skill-specific controllers. However, due to the
complex nonlinear dynamics in quadrupedal robots and reward sparsity, it is
still difficult for RL to learn effective gaits from scratch, especially in
challenging tasks such as walking over the balance beam. To alleviate such
difficulty, we propose a novel RL-based approach that contains an evolutionary
foot trajectory generator. Unlike prior methods that use a fixed trajectory
generator, the generator continually optimizes the shape of the output
trajectory for the given task, providing diversified motion priors to guide the
policy learning. The policy is trained with reinforcement learning to output
residual control signals that fit different gaits. We then optimize the
trajectory generator and policy network alternatively to stabilize the training
and share the exploratory data to improve sample efficiency. As a result, our
approach can solve a range of challenging tasks in simulation by learning from
scratch, including walking on a balance beam and crawling through the cave. To
further verify the effectiveness of our approach, we deploy the controller
learned in the simulation on a 12-DoF quadrupedal robot, and it can
successfully traverse challenging scenarios with efficient gaits.

17
The categories of this paper are: q-fin
8
The categories of this paper are: hep-ex
13
The categories of this paper are: quant-ph
22
The categories of this paper are: chao-dyn
32
The categories of this paper are: atom-ph
27
The categories of this paper are: comp-gas
16
The categories of this paper are: stat
11
The categories of this paper are: hep-lat
26
The categories of this paper are: bayes-an
21
The categories of this paper are: adap-org
19
The categories of this paper are: eess
9
The categories of this paper are: nlin
34
The categories of this paper are: chem-ph
29
The categories of this paper are: funct-an
28
The categories of this paper are: alg-geom
4
The categories of this paper are: cond-mat