mizer and a learning rate scheduler</p></li>
</ol>
</li>
<li><p><strong>Stage 2</strong>: Distillation with TextBrewer:</p>
<ol class="simple">
<li><p>Construct a <strong>TraningConfig</strong> and a <strong>DistillationConfig</strong>, initialize a <strong>distiller</strong></p></li>
<li><p>Define an <strong>adaptor</strong> and a <strong>callback</strong>. The <strong>adaptor</strong> is used for adaptation of model inputs and outputs. The <strong>callback</strong> is called by the distiller during traini