<span class="p">,</span>
<span class="lineno">106</span>                        <span class="s1">&#39;inner_iterations&#39;</span><span class="p">:</span> <span class="mi">10</span><span class="p">,</span></pre></div>
        </div>
    </div>
    <div class='section' id='section-22'>
        <div class='docs'>
            <div class='section-link'>
                <a href='#section-22'>#</a>
            </div>
            <p>GLU Variant，GLU、Bilinear、regLU、GEGLU、SwiGLU 之一</p>
<p>这些是在<a