Implementation of iteration over values of a column in an IterableDataset object
CONTRIBUTOR
A couple of questions:
1. I've noticed two strange things: 1) "Around 80% of the final dataset is made of the `en_dataset`" in https://huggingface.co/docs/datasets/stream, 2) "Click on "Pull request" to send your to the project maintainers" in https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md Are `en_dataset` and "your [???]" typos? If so, I can fix them in this PR.
2. Should I update https://huggingface.co/docs/datasets/stream or https://huggingface.co/docs/datasets/access#iterabledataset to include the new feature?
2025-05-08T15:04:40Z
https://github.com/huggingface/datasets/pull/7564#issuecomment-2863391781
https://api.github.com/repos/huggingface/datasets/issues/7564
IC_kwDODunzps6qq-Ql
https://api.github.com/repos/huggingface/datasets/issues/comments/2863391781/reactions
2025-05-08T15:04:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2863391781
https://avatars.githubusercontent.com/u/47208659?v=4
https://api.github.com/users/TopCoder2K/events{/privacy}
https://api.github.com/users/TopCoder2K/followers
https://api.github.com/users/TopCoder2K/following{/other_user}
https://api.github.com/users/TopCoder2K/gists{/gist_id}
https://github.com/TopCoder2K
TopCoder2K
MDQ6VXNlcjQ3MjA4NjU5
https://api.github.com/users/TopCoder2K/orgs
https://api.github.com/users/TopCoder2K/received_events
https://api.github.com/users/TopCoder2K/repos
https://api.github.com/users/TopCoder2K/starred{/owner}{/repo}
https://api.github.com/users/TopCoder2K/subscriptions
User
https://api.github.com/users/TopCoder2K
public
MEMBER
Great ! and chained indexing was easy indeed, thanks :)

regarding your questions:

> I've noticed two strange things: 1) "Around 80% of the final dataset is made of the en_dataset" in https://huggingface.co/docs/datasets/stream, 2) "Click on "Pull request" to send your to the project maintainers" in https://github.com/huggingface/datasets/blob/main/CONTRIBUTING.md Are en_dataset and "your [???]" typos? If so, I can fix them in this PR.

Oh good catch, both should be fixed indeed. Feel free to open a new PR for those docs fixes

> Should I update https://huggingface.co/docs/datasets/stream or https://huggingface.co/docs/datasets/access#iterabledataset to include the new feature?

Yep good idea, I think in both places, since /stream is supposed to be exhaustive, and /access already mentions accessing a specific column for `Dataset`
2025-05-14T10:16:17Z
https://github.com/huggingface/datasets/pull/7564#issuecomment-2879633544
https://api.github.com/repos/huggingface/datasets/issues/7564
IC_kwDODunzps6ro7iI
https://api.github.com/repos/huggingface/datasets/issues/comments/2879633544/reactions
2025-05-14T10:16:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2879633544
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq, thank you for the answers!

> Yep good idea, I think in both places, since /stream is supposed to be exhaustive, and /access already mentions accessing a specific column for Dataset

👍, I'll try to add something.

By the way, do you have any ideas about why the CI pipelines have failed? Essentially, I've already encountered these problems [here](https://github.com/huggingface/datasets/issues/7381#issuecomment-2863421974).
I think `check_code_quality` has failed due to the usage of `pre-commit`. The problem seems to be the old version of the ruff hook. I've tried `v0.11.8` (the one that was installed with `pip install -e ".[quality]"`) and `pre-commit` seems to work like `make style` now. However, I don't have any ideas about `pyav` since I don't know what it is...
2025-05-16T18:57:40Z
https://github.com/huggingface/datasets/pull/7564#issuecomment-2887465925
https://api.github.com/repos/huggingface/datasets/issues/7564
IC_kwDODunzps6sGzvF
https://api.github.com/repos/huggingface/datasets/issues/comments/2887465925/reactions
2025-05-16T18:57:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2887465925
https://avatars.githubusercontent.com/u/47208659?v=4
https://api.github.com/users/TopCoder2K/events{/privacy}
https://api.github.com/users/TopCoder2K/followers
https://api.github.com/users/TopCoder2K/following{/other_user}
https://api.github.com/users/TopCoder2K/gists{/gist_id}
https://github.com/TopCoder2K
TopCoder2K
MDQ6VXNlcjQ3MjA4NjU5
https://api.github.com/users/TopCoder2K/orgs
https://api.github.com/users/TopCoder2K/received_events
https://api.github.com/users/TopCoder2K/repos
https://api.github.com/users/TopCoder2K/starred{/owner}{/repo}
https://api.github.com/users/TopCoder2K/subscriptions
User
https://api.github.com/users/TopCoder2K
public
CONTRIBUTOR
I've updated /stream and /access, please check the style and clarity. By the way, I would like to add `IterableDataset.skip` near `IterableDataset.take` to mimic [slicing](https://huggingface.co/docs/datasets/access/#slicing). What do you think?
2025-05-18T19:59:46Z
https://github.com/huggingface/datasets/pull/7564#issuecomment-2889181645
https://api.github.com/repos/huggingface/datasets/issues/7564
IC_kwDODunzps6sNWnN
https://api.github.com/repos/huggingface/datasets/issues/comments/2889181645/reactions
2025-05-18T19:59:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2889181645
https://avatars.githubusercontent.com/u/47208659?v=4
https://api.github.com/users/TopCoder2K/events{/privacy}
https://api.github.com/users/TopCoder2K/followers
https://api.github.com/users/TopCoder2K/following{/other_user}
https://api.github.com/users/TopCoder2K/gists{/gist_id}
https://github.com/TopCoder2K
TopCoder2K
MDQ6VXNlcjQ3MjA4NjU5
https://api.github.com/users/TopCoder2K/orgs
https://api.github.com/users/TopCoder2K/received_events
https://api.github.com/users/TopCoder2K/repos
https://api.github.com/users/TopCoder2K/starred{/owner}{/repo}
https://api.github.com/users/TopCoder2K/subscriptions
User
https://api.github.com/users/TopCoder2K
public
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_7564). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
2025-05-19T11:57:41Z
https://github.com/huggingface/datasets/pull/7564#issuecomment-2890741168
https://api.github.com/repos/huggingface/datasets/issues/7564
IC_kwDODunzps6sTTWw
https://api.github.com/repos/huggingface/datasets/issues/comments/2890741168/reactions
2025-05-19T11:57:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2890741168
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
Refers to [this issue](https://github.com/huggingface/datasets/issues/7381).