
<li><p>high utilities will propagate</p></li>
</ul>
</li>
</ul>
</li>
<li><p>ex. active TD agent</p>
<ul>
<li><p>now must learn transitions (same as adp)</p></li>
<li><p>update rule same as passive TD</p></li>
</ul>
</li>
</ul>
</section>
<section id="learning-action-utility-function-q-s-a">
<h4><span class="section-number">1.10.5.2.2. </span>learning action-utility function <span class="math notranslate nohighlight">\(Q(s, a)\)</span><a class="headerlink" href="#learning-action-utility-function-q-s-a" tit