ns= {torch_tensorrt.dtype.f16}
)

ts_trt_model = torch.jit.trace(trt_model, torch.rand(1, 3, 224, 224).to(&quot;cuda&quot;))

# Save the model
torch.jit.save(ts_trt_model, &quot;/triton_example/model_repository/resnet50/1/model.pt&quot;)
</pre></div>
</div>
<p>You can run the script with the following command (from <code class="docutils literal notranslate"><span class="pre">//examples/triton</span></code>)</p>
<div class="highlight-cpp notranslate"><div class="highlight"><pre><span></span><span class="n">d