only on the agent‚Äôs current belief state</p>
<ul class="simple">
<li><p>use belief states as the states of an MDP and solve as before</p></li>
<li><p>changes because state space is now continuous</p></li>
</ul>
</li>
<li><p>value iteration</p>
<ol class="arabic simple">
<li><p>expected utility of executing p in belief state is just <span class="math notranslate nohighlight">\(b \cdot \alpha_p\)</span>  (dot product)</p></li>
<li><p><span class="math notranslate nohighlight">\(U(b) = U^{\pi^*}(b)=\unde