Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: RL-DARTS: Differentiable Architecture Search for Reinforcement Learning   Recently, Differentiable Architecture Search (DARTS) has become one of the
most popular Neural Architecture Search (NAS) methods successfully applied in
supervised learning (SL). However, its applications in other domains, in
particular for reinforcement learning (RL), has seldom been studied. This is
due in part to RL possessing a significantly different optimization paradigm
than SL, especially with regards to the notion of replay data, which is
continually generated via inference in RL. In this paper, we introduce
RL-DARTS, one of the first applications of end-to-end DARTS in RL to search for
convolutional cells, applied to the challenging, infinitely procedurally
generated Procgen benchmark. We demonstrate that the benefits of DARTS become
amplified when applied to RL, namely search efficiency in terms of time and
compute, as well as simplicity in integration with complex preexisting RL code
via simply replacing the image encoder with a DARTS supernet, compatible with
both off-policy and on-policy RL algorithms. At the same time however, we
provide one of the first extensive studies of DARTS outside of the standard
fixed dataset setting in SL via RL-DARTS. We show that throughout training, the
supernet gradually learns better cells, leading to alternative architectures
which can be highly competitive against manually designed policies, but also
verify previous design choices for RL policies.

18
The categories of this paper are: econ
11
The categories of this paper are: hep-lat
16
The categories of this paper are: stat
20
The categories of this paper are: acc-phys
9
The categories of this paper are: nlin
3
The categories of this paper are: physics
5
The categories of this paper are: gr-qc
28
The categories of this paper are: alg-geom
2
The categories of this paper are: math
4
The categories of this paper are: cond-mat
21
The categories of this paper are: adap-org
24
The categories of this paper are: dg-ga
31
The categories of this paper are: ao-sci
30
The categories of this paper are: q-alg
25
The categories of this paper are: patt-sol
36
The categories of this paper are: cmp-lg