ng</p></li>
<li><p>Call the <strong>train</strong> method of the <strong>distiller</strong></p></li>
</ol>
</li>
</ul>
</div>
<div class="section" id="id1">
<h2>Quickstart<a class="headerlink" href="#id1" title="Permalink to this headline">¶</a></h2>
<p>Here we show the usage of TextBrewer by distilling BERT-base to a 3-layer BERT.</p>
<p>Before distillation, we assume users have provided:</p>
<ul class="simple">
<li><p>A trained teacher model <code class="docutils literal notranslate"><span class="pre">te