{i+1}-U \vert  \vert &lt;\epsilon\)</span></p></li>
<li><p>what actually matters is <em>policy loss</em> <span class="math notranslate nohighlight">\( \vert  \vert U^{\pi_i}-U \vert  \vert \)</span> - the most the agent can lose by executing <span class="math notranslate nohighlight">\(\pi_i\)</span> instead of the optimal policy <span class="math notranslate nohighlight">\(\pi^*\)</span></p>
<ul>
<li><p>if <span class="math notranslate nohighlight">\( \vert  \vert U_i -U \vert  \vert  &lt; \epsilon\)</span