kenization.PororoTokenizerBase" title="Permalink to this definition">¶</a></dt>
<dd><p>Bases: <code class="xref py py-class docutils literal notranslate"><span class="pre">pororo.tasks.utils.base.PororoSimpleBase</span></code></p>
<dl class="py method">
<dt id="pororo.tasks.tokenization.PororoTokenizerBase.detokenize">
<em class="property">abstract </em><code class="sig-name descname">detokenize</code><span class="sig-paren">(</span><em class="sig-param"><span class="n">tokens</span><span class="p">:</span