SA is <em>on-policy</em> (pays attention to actual policy being followed)</p></li>
</ul>
</li>
<li><p>can approximate Q-function with something other than a lookup table</p>
<ul>
<li><p>ex. linear function of parameters <span class="math notranslate nohighlight">\(\hat{U}_\theta(s) = \theta_1f_1(s) + ... + \theta_n f_n(s)\)</span></p>
<ul>
<li><p>can learn params online with <em>delta rule</em> = <em>wildrow-hoff rule</em>: <span class="math notranslate nohighlight">\(\theta_i = \theta - \alpha \: \frac{\pa