on experiments on several typical English and Chinese NLP datasets. The setups and configurations are listed below.</p>
<div class="section" id="models">
<h3>Models<a class="headerlink" href="#models" title="Permalink to this headline">¶</a></h3>
<ul class="simple">
<li><p>For English tasks, the teacher model is <a class="reference external" href="https://github.com/google-research/bert"><strong>BERT-base-cased</strong></a>.</p></li>
<li><p>For Chinese tasks, the teacher model is <a class="reference extern