ify the model architectures</p></li>
<li><p>Built for NLP: it is suitable for a wide variety of NLP tasks: text classification, machine reading comprehension, sequence labeling, …</p></li>
</ul>
<p><strong>TextBrewer</strong> currently is shipped with the following distillation techniques:</p>
<ul class="simple">
<li><p>Mixed soft-label and hard-label training</p></li>
<li><p>Dynamic loss weight adjustment and temperature adjustment</p></li>
<li><p>Various distillation loss functions: hidden states MSE, a