d="deploying-a-torch-tensorrt-model-to-triton">
<h1>Deploying a Torch-TensorRT model (to Triton)<a class="headerlink" href="#deploying-a-torch-tensorrt-model-to-triton" title="Permalink to this headline">¶</a></h1>
<p>Optimization and deployment go hand in hand in a discussion about Machine
Learning infrastructure. Once network level optimzation are done
to get the maximum performance, the next step would be to deploy it.</p>
<p>However, serving this optimized model comes with it’s own set of considerati