 the tool onnxruntime/tools/python/remove_initializer_from_input.py.
</pre></div></div>
</div>
<section id="QGEMM-vs-GEMM">
<h4>QGEMM vs GEMM<a class="headerlink" href="#QGEMM-vs-GEMM" title="Permalink to this heading">#</a></h4>
<p>QCDQ allows to execute low precision fake-quantization in ONNX Runtime, meaning operations actually happen among floating-point values. ONNX Runtime is also capable of optimizing and accelerating a QCDQ model leveraging a int8 based QGEMM kernels in some scenarios.</p>
<p>This s