Downloading/caching only a part of a datasets' dataset.
MEMBER
Not at the moment but we could likely support this feature.
2020-11-24T14:33:56Z
https://github.com/huggingface/datasets/issues/883#issuecomment-733012479
https://api.github.com/repos/huggingface/datasets/issues/883
MDEyOklzc3VlQ29tbWVudDczMzAxMjQ3OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/733012479/reactions
2020-11-24T14:33:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/733012479
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
NONE
?
2020-11-24T14:51:04Z
https://github.com/huggingface/datasets/issues/883#issuecomment-733023234
https://api.github.com/repos/huggingface/datasets/issues/883
MDEyOklzc3VlQ29tbWVudDczMzAyMzIzNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/733023234/reactions
2020-11-24T14:51:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/733023234
https://avatars.githubusercontent.com/u/74707876?v=4
https://api.github.com/users/jman1973/events{/privacy}
https://api.github.com/users/jman1973/followers
https://api.github.com/users/jman1973/following{/other_user}
https://api.github.com/users/jman1973/gists{/gist_id}
https://github.com/jman1973
jman1973
MDQ6VXNlcjc0NzA3ODc2
https://api.github.com/users/jman1973/orgs
https://api.github.com/users/jman1973/received_events
https://api.github.com/users/jman1973/repos
https://api.github.com/users/jman1973/starred{/owner}{/repo}
https://api.github.com/users/jman1973/subscriptions
User
https://api.github.com/users/jman1973
public
NONE
I think it would be a very helpful feature, because sometimes one only wants to evaluate models on the dev set, and the whole training data may be many times bigger.
This makes the task impossible with limited memory resources.
2020-11-24T14:51:41Z
https://github.com/huggingface/datasets/issues/883#issuecomment-733023637
https://api.github.com/repos/huggingface/datasets/issues/883
MDEyOklzc3VlQ29tbWVudDczMzAyMzYzNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/733023637/reactions
2020-11-24T14:51:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/733023637
https://avatars.githubusercontent.com/u/44585792?v=4
https://api.github.com/users/SapirWeissbuch/events{/privacy}
https://api.github.com/users/SapirWeissbuch/followers
https://api.github.com/users/SapirWeissbuch/following{/other_user}
https://api.github.com/users/SapirWeissbuch/gists{/gist_id}
https://github.com/SapirWeissbuch
SapirWeissbuch
MDQ6VXNlcjQ0NTg1Nzky
https://api.github.com/users/SapirWeissbuch/orgs
https://api.github.com/users/SapirWeissbuch/received_events
https://api.github.com/users/SapirWeissbuch/repos
https://api.github.com/users/SapirWeissbuch/starred{/owner}{/repo}
https://api.github.com/users/SapirWeissbuch/subscriptions
User
https://api.github.com/users/SapirWeissbuch
public
Hi,
I want to use the validation data *only* (of natural question).
I don't want to have the whole dataset cached in my machine, just the dev set.
Is this possible? I can't find a way to do it in the docs.

Thank you,
Sapir