pan class="n">prefer_deferred_runtime_asserts_over_guards</span><span class="o">=</span><span class="kc">True</span><span class="p">,</span>
<span class="p">)</span>
</pre></div>
</div>
</section>
<section id="torch-tensorrt-compilation">
<h2>Torch-TensorRT compilation<a class="headerlink" href="#torch-tensorrt-compilation" title="Permalink to this heading">¶</a></h2>
<div class="admonition note">
<p class="admonition-title">Note</p>
<p>The compilation requires a GPU with high memory (&gt; 80GB) since Tens