            <a href='#section-9'>#</a>
            </div>
            <h2>Configurations</h2>
<p>This inherits from <a href="../../experiments/nlp_autoregression.html"><code  class="highlight"><span></span><span class="n">NLPAutoRegressionConfigs</span></code>
</a> because it has the data pipeline implementations that we reuse here. We have implemented a custom training step form MLM.</p>

        </div>
        <div class='code'>
            <div class="highlight"><pre><span class="lineno">57</span><span c