</a></h1>
<section id="ahead-of-time-compilation-of-torchscript-pytorch-jit-for-nvidia-gpus">
<h2>Ahead-of-time compilation of TorchScript / PyTorch JIT for NVIDIA GPUs<a class="headerlink" href="#ahead-of-time-compilation-of-torchscript-pytorch-jit-for-nvidia-gpus" title="Permalink to this headline">¶</a></h2>
<p>Torch-TensorRT is a compiler for PyTorch/TorchScript, targeting NVIDIA GPUs via NVIDIA’s TensorRT Deep Learning Optimizer and Runtime.
Unlike PyTorch’s Just-In-Time (JIT) compiler, Torch-Tens