r customized policy objects</span>

<span class="sd">    Notes:</span>
<span class="sd">        The parallelization process is performed through the following process.</span>

<span class="sd">        1) slice parallelizable tensors and replace original tensors on CPU</span>
<span class="sd">        2) upload parallelizable (replaced) tensors to multiple GPUs simultaneously</span>
<span class="sd">        3) upload non-parallelizable tensors to multiple GPUs (e.g. embedding, lm_head, ...)</span>
<span class