in 2019."></a>
                        <a href="DeBertaEmbeddings.html" title="The DeBERTa model was proposed in DeBERTa: Decoding-enhanced BERT with Disentangled Attention by Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen It is based on Google’s BERT model released in 2018 and Facebook’s RoBERTa model released in 2019.">DeBertaEmbeddings</a>
                      </li><li class="current-entities indented4">
                        <a class="object" href="DistilBertEmbeddings$.html" title="This i