Easily create loading script for benchmark comprising multiple huggingface datasets
MEMBER
Hi ! I think the simplest is to copy paste the `_split_generators` code from the other datasets and do a bunch of if-else, as in the glue dataset: https://huggingface.co/datasets/glue/blob/main/glue.py#L467
2022-07-27T13:46:59Z
https://github.com/huggingface/datasets/issues/4750#issuecomment-1196785191
https://api.github.com/repos/huggingface/datasets/issues/4750
IC_kwDODunzps5HVX4n
https://api.github.com/repos/huggingface/datasets/issues/comments/1196785191/reactions
2022-07-27T13:46:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1196785191
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Ok, I see. Thank you
2022-07-27T13:58:07Z
https://github.com/huggingface/datasets/issues/4750#issuecomment-1196798339
https://api.github.com/repos/huggingface/datasets/issues/4750
IC_kwDODunzps5HVbGD
https://api.github.com/repos/huggingface/datasets/issues/comments/1196798339/reactions
2022-07-27T13:58:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1196798339
https://avatars.githubusercontent.com/u/3775944?v=4
https://api.github.com/users/JoelNiklaus/events{/privacy}
https://api.github.com/users/JoelNiklaus/followers
https://api.github.com/users/JoelNiklaus/following{/other_user}
https://api.github.com/users/JoelNiklaus/gists{/gist_id}
https://github.com/JoelNiklaus
JoelNiklaus
MDQ6VXNlcjM3NzU5NDQ=
https://api.github.com/users/JoelNiklaus/orgs
https://api.github.com/users/JoelNiklaus/received_events
https://api.github.com/users/JoelNiklaus/repos
https://api.github.com/users/JoelNiklaus/starred{/owner}{/repo}
https://api.github.com/users/JoelNiklaus/subscriptions
User
https://api.github.com/users/JoelNiklaus
public
Hi,

I would like to create a loading script for a benchmark comprising multiple huggingface datasets.
The function _split_generators needs to return the files for the respective dataset. However, the files are not always in the same location for each dataset. I want to just make a wrapper dataset that provides a single interface to all the underlying datasets. 
I thought about downloading the files with the load_dataset function and then providing the link to the cached file. But this seems a bit inelegant to me. What approach would you propose to do this?

Please let me know if you have any questions.

Cheers,
Joel