f="../../../parallel/Replacing.html#parallelformers.parallel.replacing.TensorReplacer.make_megatron_layer">[docs]</a>    <span class="k">def</span> <span class="nf">make_megatron_layer</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">policy</span><span class="p">:</span> <span class="n">Policy</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="n">nn</span><span class="o">.</span><span class="n">Module</span><span class="p">:</span>
    