Rebatch arrow iterables before formatted iterable
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_7553). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
2025-05-06T14:02:49Z
https://github.com/huggingface/datasets/pull/7553#issuecomment-2854699822
https://api.github.com/repos/huggingface/datasets/issues/7553
IC_kwDODunzps6qJ0Mu
https://api.github.com/repos/huggingface/datasets/issues/comments/2854699822/reactions
2025-05-06T14:02:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2854699822
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
@lhoestq Our CI found an issue with this changeset causing a regression with shuffling iterable datasets 
<img width="884" alt="Screenshot 2025-05-07 at 9 16 52 AM" src="https://github.com/user-attachments/assets/bf7d9c7e-cc14-47da-8da6-d1a345992d7c" />

2025-05-07T13:17:40Z
https://github.com/huggingface/datasets/pull/7553#issuecomment-2858566975
https://api.github.com/repos/huggingface/datasets/issues/7553
IC_kwDODunzps6qYkU_
https://api.github.com/repos/huggingface/datasets/issues/comments/2858566975/reactions
2025-05-07T13:17:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2858566975
https://avatars.githubusercontent.com/u/381258?v=4
https://api.github.com/users/winglian/events{/privacy}
https://api.github.com/users/winglian/followers
https://api.github.com/users/winglian/following{/other_user}
https://api.github.com/users/winglian/gists{/gist_id}
https://github.com/winglian
winglian
MDQ6VXNlcjM4MTI1OA==
https://api.github.com/users/winglian/orgs
https://api.github.com/users/winglian/received_events
https://api.github.com/users/winglian/repos
https://api.github.com/users/winglian/starred{/owner}{/repo}
https://api.github.com/users/winglian/subscriptions
User
https://api.github.com/users/winglian
public
close https://github.com/huggingface/datasets/issues/7538 and https://github.com/huggingface/datasets/issues/7475