w-shuffle-descriptors-are-distributed.svg" width="80%"/>
<br/>
Fig. 3 - How ShuffleDescriptors are distributed
</center>
<br/>
<p>To avoid running out of space on the local disk, the cache will be cleared when the related partitions are no longer valid and a size limit is added for ShuffleDescriptors in the blob cache on TaskManagers. If the overall size exceeds the limit, the least recently used cached value will be removed. This ensures that the local disks on the JobManager and TaskManagers won&rsquo;t b