s="p">]</span></span></em><span class="sig-paren">)</span><a class="reference internal" href="../_modules/pororo/tasks/tokenization.html#PororoTokenizerBase.convert_tokens_to_ids"><span class="viewcode-link">[source]</span></a><a class="headerlink" href="#pororo.tasks.tokenization.PororoTokenizerBase.convert_tokens_to_ids" title="Permalink to this definition">¶</a></dt>
<dd></dd></dl>

</dd></dl>

<dl class="py class">
<dt id="pororo.tasks.tokenization.PororoSentTokenizer">
<em class="property">class </em>