a class="reference internal" href="#pororo.tasks.tokenization.PororoTokenizerBase" title="pororo.tasks.tokenization.PororoTokenizerBase"><code class="xref py py-class docutils literal notranslate"><span class="pre">pororo.tasks.tokenization.PororoTokenizerBase</span></code></a></p>
<dl class="py method">
<dt id="pororo.tasks.tokenization.PororoMecabTokenizer.detokenize">
<code class="sig-name descname">detokenize</code><span class="sig-paren">(</span><em class="sig-param"><span class="n">tokens</span><span 