ass="math notranslate nohighlight">\(\pi_i\)</span>, calculate <span class="math notranslate nohighlight">\(U_i=U^{\pi_i}\)</span>, the utility of each state if <span class="math notranslate nohighlight">\(\pi_i\)</span> were to be executed</p></li>
</ol>
<ul class="simple">
<li><p>like value iteration, but with a set policy so there‚Äôs no max</p>
<ul>
<li><p><span class="math notranslate nohighlight">\(U_i(s) = R(s) + \gamma \: \sum_{s'} P(s' \vert s, \pi_i(s)) U_i(s')\)</span></p></li>
<li><p>can sol