t.ai (-&gt; language_model_learner()) and the fine-tuning takes care of adding and training unknown tokens! This approach gave slightly better results than reusing the SP-Model from the language model.</p>

</div>
</div>
</div>
<div class="cell border-box-sizing text_cell rendered"><div class="inner_cell">
<div class="text_cell_render border-box-sizing rendered_html">
<h3 id="4.-Train-the-classifier">4. Train the classifier<a class="anchor-link" href="#4.-Train-the-classifier"> </a></h3><p>Notebook: <code>4