pan class="p">:</span> <span class="nb">str</span> <span class="o">=</span> <span class="s2">&quot;optimizer&quot;</span><span class="p">):</span>
<span class="w">    </span><span class="sd">&quot;&quot;&quot;</span>
<span class="sd">    Track optimizer stats such as moments.</span>

<span class="sd">    Arguments:</span>
<span class="sd">        optimizer (Optimizer): PyTorch optimizer</span>

<span class="sd">    Keyword Arguments:</span>
<span class="sd">        models (Dict[str, torch.nn.Module], option