Instruct: Identify the main and secondary category of Arxiv papers based on the titles and abstracts
Query: Parameter-Based Value Functions   Traditional off-policy actor-critic Reinforcement Learning (RL) algorithms
learn value functions of a single target policy. However, when value functions
are updated to track the learned policy, they forget potentially useful
information about old policies. We introduce a class of value functions called
Parameter-Based Value Functions (PBVFs) whose inputs include the policy
parameters. They can generalize across different policies. PBVFs can evaluate
the performance of any policy given a state, a state-action pair, or a
distribution over the RL agent's initial states. First we show how PBVFs yield
novel off-policy policy gradient theorems. Then we derive off-policy
actor-critic algorithms based on PBVFs trained by Monte Carlo or Temporal
Difference methods. We show how learned PBVFs can zero-shot learn new policies
that outperform any policy seen during training. Finally our algorithms are
evaluated on a selection of discrete and continuous control tasks using shallow
policies and deep neural networks. Their performance is comparable to
state-of-the-art methods.

22
The categories of this paper are: chao-dyn
9
The categories of this paper are: nlin
37
The categories of this paper are: supr-con
25
The categories of this paper are: patt-sol
30
The categories of this paper are: q-alg
29
The categories of this paper are: funct-an
15
The categories of this paper are: nucl-ex
23
The categories of this paper are: solv-int
17
The categories of this paper are: q-fin
0
The categories of this paper are: hep-ph
10
The categories of this paper are: q-bio
27
The categories of this paper are: comp-gas
35
The categories of this paper are: mtrl-th
11
The categories of this paper are: hep-lat
8
The categories of this paper are: hep-ex
28
The categories of this paper are: alg-geom