 (<a href="#ref-kucukelbir:2017" role="doc-biblioref">2017</a>)</span>. In this chapter, we describe the specifics of how ADVI maximizes the variational objective.</p>
<section id="stochastic-gradient-ascent" class="level2">
<h2 class="anchored" data-anchor-id="stochastic-gradient-ascent">Stochastic gradient ascent</h2>
<p>ADVI optimizes the ELBO in the real-coordinate space using stochastic gradient ascent. We obtain noisy (yet unbiased) gradients of the variational objective using automatic differentiatio