   <div class='section-link'>
                <a href='#section-30'>#</a>
            </div>
            <p>Update global step (number of tokens processed) when in training mode </p>

        </div>
        <div class='code'>
            <div class="highlight"><pre><span class="lineno">139</span>        <span class="k">if</span> <span class="bp">self</span><span class="o">.</span><span class="n">mode</span><span class="o">.</span><span class="n">is_train</span><span class="p">:</span>
<span class="lineno">1