    <span class="sd">&quot;&quot;&quot;</span>
<span class="sd">        Make Megatron tensor sliced layers from original Huggingface layers by tensor slicing.</span>

<span class="sd">        Args:</span>
<span class="sd">            policy (Policy): policy object</span>

<span class="sd">        Returns:</span>
<span class="sd">            nn.Module: sliced model layer</span>
<span class="sd">        &quot;&quot;&quot;</span>
        <span class="n">attn_qkvw</span><span class="p">,</span> <span class="n">