an>
<span class="sd">        Create Pytorch distributed process group</span>

<span class="sd">        Args:</span>
<span class="sd">            backend (str): distributed backend</span>

<span class="sd">        Returns:</span>
<span class="sd">            ProcessGroupNCCL: process group for parallization</span>
<span class="sd">        &quot;&quot;&quot;</span>
        <span class="k">if</span> <span class="ow">not</span> <span class="n">dist</span><span class="o">.</span><span class="n">is_initialized</s