acher_model</span></code> (BERT-base) and a to-be-trained student model <code class="docutils literal notranslate"><span class="pre">student_model</span></code> (3-layer BERT).</p></li>
<li><p>a <code class="docutils literal notranslate"><span class="pre">dataloader</span></code> of the dataset, an <code class="docutils literal notranslate"><span class="pre">optimizer</span></code> and a learning rate <code class="docutils literal notranslate"><span class="pre">scheduler</span></code>.</p></li>
</ul>
<p>Dis