agate gradients into the policy</p></li>
<li><p>use the model to learn a value function</p></li>
</ul>
</li>
</ul>
</li>
</ul>
<div class="pst-scrollable-table-container"><table class="table">
<thead>
<tr class="row-odd"><th class="head"><p></p></th>
<th class="head"><p>fit model / estimate return</p></th>
<th class="head"><p>improve policy</p></th>
</tr>
</thead>
<tbody>
<tr class="row-even"><td><p>value-based</p></td>
<td><p>fit <span class="math notranslate nohighlight">\(V(s)\)</span> or <span class="ma