Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Programmatic Reward Design by Example   Reward design is a fundamental problem in reinforcement learning (RL). A
misspecified or poorly designed reward can result in low sample efficiency and
undesired behaviors. In this paper, we propose the idea of programmatic reward
design, i.e. using programs to specify the reward functions in RL environments.
Programs allow human engineers to express sub-goals and complex task scenarios
in a structured and interpretable way. The challenge of programmatic reward
design, however, is that while humans can provide the high-level structures,
properly setting the low-level details, such as the right amount of reward for
a specific sub-task, remains difficult. A major contribution of this paper is a
probabilistic framework that can infer the best candidate programmatic reward
function from expert demonstrations. Inspired by recent generative-adversarial
approaches, our framework searches for the most likely programmatic reward
function under which the optimally generated trajectories cannot be
differentiated from the demonstrated trajectories. Experimental results show
that programmatic reward functionslearned using this framework can
significantly outperform those learned using existing reward learning
algo-rithms, and enable RL agents to achieve state-of-the-artperformance on
highly complex tasks.

0
The categories of this paper are: hep-ph
8
The categories of this paper are: hep-ex
13
The categories of this paper are: quant-ph
30
The categories of this paper are: q-alg
37
The categories of this paper are: supr-con
29
The categories of this paper are: funct-an
31
The categories of this paper are: ao-sci
3
The categories of this paper are: physics
34
The categories of this paper are: chem-ph
25
The categories of this paper are: patt-sol
32
The categories of this paper are: atom-ph
5
The categories of this paper are: gr-qc
22
The categories of this paper are: chao-dyn
12
The categories of this paper are: nucl-th
18
The categories of this paper are: econ
36
The categories of this paper are: cmp-lg