Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Positive-Unlabeled Reward Learning   Learning reward functions from data is a promising path towards achieving
scalable Reinforcement Learning (RL) for robotics. However, a major challenge
in training agents from learned reward models is that the agent can learn to
exploit errors in the reward model to achieve high reward behaviors that do not
correspond to the intended task. These reward delusions can lead to unintended
and even dangerous behaviors. On the other hand, adversarial imitation learning
frameworks tend to suffer the opposite problem, where the discriminator learns
to trivially distinguish agent and expert behavior, resulting in reward models
that produce low reward signal regardless of the input state. In this paper, we
connect these two classes of reward learning methods to positive-unlabeled (PU)
learning, and we show that by applying a large-scale PU learning algorithm to
the reward learning problem, we can address both the reward under- and
over-estimation problems simultaneously. Our approach drastically improves both
GAIL and supervised reward learning, without any additional assumptions.

14
The categories of this paper are: math-ph
32
The categories of this paper are: atom-ph
24
The categories of this paper are: dg-ga
5
The categories of this paper are: gr-qc
37
The categories of this paper are: supr-con
28
The categories of this paper are: alg-geom
8
The categories of this paper are: hep-ex
25
The categories of this paper are: patt-sol
15
The categories of this paper are: nucl-ex
3
The categories of this paper are: physics
36
The categories of this paper are: cmp-lg
17
The categories of this paper are: q-fin
30
The categories of this paper are: q-alg
19
The categories of this paper are: eess
18
The categories of this paper are: econ
13
The categories of this paper are: quant-ph