tion <span class="math notranslate nohighlight">\(s \to s'\)</span>, update <span class="math notranslate nohighlight">\(U^\pi(s) = U^\pi (s) + \alpha \left[R(s) - U^\pi (s) + \gamma \:U^\pi (s') \right]\)</span></p>
<ul>
<li><p><span class="math notranslate nohighlight">\(\alpha\)</span> should decrease over time to converge</p></li>
</ul>
</li>
<li><p><em>prioritized sweeping</em> - prefer adjustments to states whose likely successors have just undergone a large adjustment in their own utility estimates</