xternal" href="https://arxiv.org/abs/1910.01108">DistilBERT<sup>[1]</sup></a>, <a class="reference external" href="https://arxiv.org/abs/1908.09355">BERT<sub>6</sub>-PKD<sup>[2]</sup></a>, and  <a class="reference external" href="https://arxiv.org/abs/2002.02925">BERT-of-Theseus<sup>[3]</sup></a>.</p></li>
<li><p>T4-tiny archtecture is the same as <a class="reference external" href="https://arxiv.org/abs/1909.10351">TinyBERT<sup>[4]</sup></a>.</p></li>
<li><p>T3 architecure is the same as <a class="referenc