l</span>
<span class="sd">        Whether to segment the square brackets `&quot;[&quot;` and `&quot;]&quot;` as tokens.</span>
<span class="sd">        The default is `True`.</span>

<span class="sd">    Returns</span>
<span class="sd">    -------</span>
<span class="sd">    List[str]</span>
<span class="sd">        A list of tokens.</span>
<span class="sd">    &quot;&quot;&quot;</span>
    <span class="n">regex</span> <span class="o">=</span> <span class="n">_RE_PATTERNS</span><span class="p">[</span><span