anslate"><div class="highlight"><pre><span></span># Model benchmark without Torch-TensorRT
model = resnet50_model.eval().to(&quot;cuda&quot;)
benchmark(model, input_shape=(128, 3, 224, 224), nruns=100)
</pre></div>
</div>
</div>
<div class="nboutput nblast docutils container">
<div class="prompt empty docutils container">
</div>
<div class="output_area docutils container">
<div class="highlight"><pre>
Warm up ...
Start timing ...
Iteration 10/100, ave batch time 75.34 ms
Iteration 20/100, ave batch time 75.