 at <a class="reference external" href="exmaple/matches/matches.py">exmaple/matches/matches.py</a>.</p>
<p>We use GeneralDistiller in all the distillation experiments.</p>
</div>
<div class="section" id="training-configurations">
<h3>Training Configurations<a class="headerlink" href="#training-configurations" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>Learning rate is 1e-4 (unless otherwise specified).</p></li>
<li><p>We train all the models for 30~60 epochs.</p></li>
</ul>
</