th Torch TensorRT;
trt_model = torch_tensorrt.compile(model,
    inputs= [torch_tensorrt.Input((1, 3, 224, 224))],
    enabled_precisions= { torch.half} # Run with FP32
)

# Save the model
torch.jit.save(trt_model, &quot;model.pt&quot;)
</pre></div>
</div>
<p>After copying the model, exit the container. The next step in the process
is to set up a Triton Inference Server.</p>
</section>
<section id="step-2-set-up-triton-inference-server">
<h2>Step 2: Set Up Triton Inference Server<a class="headerlink" href="