Impossible to only download a test split
MEMBER
The only way right now is to load with streaming=True
2023-12-22T20:46:28Z
https://github.com/huggingface/datasets/issues/6529#issuecomment-1868058659
https://api.github.com/repos/huggingface/datasets/issues/6529
IC_kwDODunzps5vWFAj
https://api.github.com/repos/huggingface/datasets/issues/comments/1868058659/reactions
2023-12-22T20:46:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1868058659
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
This feature has been proposed for a long time. I'm looking forward to the implementation. On clusters `streaming=True` is not an option since we do not have Internet on compute nodes. See: https://github.com/huggingface/datasets/discussions/1896#discussioncomment-2359593
2024-02-02T00:05:03Z
https://github.com/huggingface/datasets/issues/6529#issuecomment-1922521905
https://api.github.com/repos/huggingface/datasets/issues/6529
IC_kwDODunzps5yl1sx
https://api.github.com/repos/huggingface/datasets/issues/comments/1922521905/reactions
2024-02-02T00:05:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1922521905
https://avatars.githubusercontent.com/u/43395692?v=4
https://api.github.com/users/why-in-Shanghaitech/events{/privacy}
https://api.github.com/users/why-in-Shanghaitech/followers
https://api.github.com/users/why-in-Shanghaitech/following{/other_user}
https://api.github.com/users/why-in-Shanghaitech/gists{/gist_id}
https://github.com/why-in-Shanghaitech
why-in-Shanghaitech
MDQ6VXNlcjQzMzk1Njky
https://api.github.com/users/why-in-Shanghaitech/orgs
https://api.github.com/users/why-in-Shanghaitech/received_events
https://api.github.com/users/why-in-Shanghaitech/repos
https://api.github.com/users/why-in-Shanghaitech/starred{/owner}{/repo}
https://api.github.com/users/why-in-Shanghaitech/subscriptions
User
https://api.github.com/users/why-in-Shanghaitech
public
I've spent a significant amount of time trying to locate the split object inside my _split_generators() custom function.
Then after diving [in the code](https://github.com/huggingface/datasets/blob/5ff3670c18ed34fa8ddfa70a9aa403ae6cc9ad54/src/datasets/load.py#L2558) I realized that `download_and_prepare` is executed before! split is passed to the dataset builder in `as_dataset`.

If I'm not missing something, this seems like bad design, for the following use case:

> Imagine there is a huge dataset that has an evaluation test set and you want to just download and run just to compare your method.

Is there a current workaround that can help me achieve the same result?

Thank you,