en by a batch of input
benchmark(trt_model_fp16, input_shape=(128, 3, 224, 224), dtype=&#39;fp16&#39;, nruns=100)
</pre></div>
</div>
</div>
<div class="nboutput nblast docutils container">
<div class="prompt empty docutils container">
</div>
<div class="output_area docutils container">
<div class="highlight"><pre>
Warm up ...
Start timing ...
Iteration 10/100, ave batch time 14.48 ms
Iteration 20/100, ave batch time 14.58 ms
Iteration 30/100, ave batch time 14.72 ms
Iteration 40/100, ave batch time 14.73 m