-critic</p></td>
<td><p>fit <span class="math notranslate nohighlight">\(V(s)\)</span> or <span class="math notranslate nohighlight">\(Q(s, a)\)</span></p></td>
<td><p><span class="math notranslate nohighlight">\(\theta = \theta + \alpha \nabla_\theta E[Q(s, a)]\)</span></p></td>
</tr>
<tr class="row-odd"><td><p>model-based</p></td>
<td><p>maybe model $P(s‚Äô</p></td>
<td><p>s, a)$</p></td>
</tr>
</tbody>
</table>
</div>
<ul class="simple">
<li><p>sample efficiency</p>
<ul>
<li><p>on policy - must gener