s="mopen">(</span><span class="mord">⋅</span><span class="mclose">)</span></span></span></span></span>是令牌嵌入的线性变换。</p>

        </div>
        <div class='code'>
            <div class="highlight"><pre><span class="lineno">97</span>        <span class="n">route_prob</span> <span class="o">=</span> <span class="bp">self</span><span class="o">.</span><span class="n">softmax</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">switch</span><sp