"n">feed_forward</span></code>
是前馈模块（在本例中为交换模块）</li>
<li><code  class="highlight"><span></span><span class="n">dropout_prob</span></code>
是自我关注和 FFN 后退学的概率</li></ul>

        </div>
        <div class='code'>
            <div class="highlight"><pre><span class="lineno">176</span>    <span class="k">def</span> <span class="fm">__init__</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="o">*</span><span class=