he performance impact of the optimization. With Torch-TensorRT, we observe a speedup of
        <strong>
         1.35x
        </strong>
        with FP32, and
        <strong>
         3.13x
        </strong>
        with FP16 on an NVIDIA 3090 GPU. These acceleration numbers will vary from GPU to GPU(as well as implementation to implementation based on the ops used) and we encorage you to try out latest generation of Data center compute
cards for maximum acceleration.
       </p>
       <h3 id="What’s-