cial tokens, e.g. masking etc.</p></div><dl class="attributes block"> <dt>Attributes</dt><dd>protected </dd><dt>Definition Classes</dt><dd>BpeTokenizer</dd></dl></div>
    </li><li name="com.johnsnowlabs.nlp.annotators.tokenizer.bpe.MLLamaTokenizer#splitPattern" visbl="pub" class="indented0 " data-isabs="false" fullComment="no" group="Ungrouped">
      <a id="splitPattern:scala.util.matching.Regex"></a><a id="splitPattern:Regex"></a>
      <span class="permalink">
      <a href="../../../../../../com/johnsn