LayerNorm.bias&#39;, &#39;predictions.dense.weight&#39;, &#39;predictions.LayerNorm.weight&#39;, &#39;predictions.bias&#39;, &#39;predictions.decoder.weight&#39;, &#39;predictions.decoder.bias&#39;, &#39;predictions.dense.bias&#39;]
- This IS expected if you are initializing TFAlbertModel from a PyTorch model trained on another task or with another architecture (e.g. initializing a TFBertForSequenceClassification model from a BertForPreTraining model).
- This IS NOT expected if you are initializing TFAlbert