       </li><li class="current-entities indented4">
                        <a class="object" href="DeBertaEmbeddings$.html" title="This is the companion object of DeBertaEmbeddings."></a>
                        <a class="class" href="DeBertaEmbeddings.html" title="The DeBERTa model was proposed in DeBERTa: Decoding-enhanced BERT with Disentangled Attention by Pengcheng He, Xiaodong Liu, Jianfeng Gao, Weizhu Chen It is based on Google’s BERT model released in 2018 and Facebook’s RoBERTa model released 