-part-4-improving-the-training-target-6efba2e71628">Prasad, Abrams &amp; Young, 2018</a>) and <em>warmup</em>. Some techniques for tournament play may also have helped training speed and quality.</p>
        <p>Training was implemented to be flexible, scaling from single-GPU up to multi-GPU and v3-8 TPU scenarios. To achieve this, the base training batch size was set to 512 rather than 4,096 and multiplied along with learning rate by the number of devices; correspondingly, the total training steps were set 