lass="nb">bool</span><span class="p">)</span> <span class="o">-&gt;</span> <span class="n">nn</span><span class="o">.</span><span class="n">Module</span><span class="p">:</span>
        <span class="sd">&quot;&quot;&quot;</span>
<span class="sd">        Parallelize model to multiple GPUs</span>

<span class="sd">        Args:</span>
<span class="sd">            model (nn.Module): Huggingface pre-trained transformer model.</span>
<span class="sd">            fp16: (bool): whether use FP16 or not.</span>

<sp