um_{s'} P(s' \vert s,a) U'(s)\)</span></p></li>
</ul>
</li>
<li><p><em>asynchronous policy iteration</em> - don‚Äôt have to update all states at once</p></li>
</ul>
</section>
<section id="partially-observable-markov-decision-processes-pomdp">
<h3><span class="section-number">1.10.4.3. </span>partially observable markov decision processes (POMDP)<a class="headerlink" href="#partially-observable-markov-decision-processes-pomdp" title="Link to this heading">#</a></h3>
<ul>
<li><p>agent is not sure what st