 that only two QuantTensor with the same scale factor can be summed together. This constrain is enforced
when the QuantTensors involved in a sum have been generated in inference mode, but it’s not enforced in training mode.
This is because when dealing with e.g. <cite>ScalingImplType.PARAMETER_FROM_STATS</cite>, the activation tensors in a residual topology
can have different scale factors along the skip connection at training time, but not at inference time.</p>
</section>
<section id="proxies">
<h2>Prox