uot;</span>
<span class="sd">        Replace original Huggingface layers to Megatron tensor sliced layers</span>

<span class="sd">        Args:</span>
<span class="sd">            model (nn.Module): model weight</span>
<span class="sd">            policy_cls (Type[Policy]): class of policy</span>

<span class="sd">        Returns:</span>
<span class="sd">            nn.Module: parallelized paramerters</span>
<span class="sd">        &quot;&quot;&quot;</span>
        <span class="k">for</span> <span class="