Stream TAR-based dataset using iter_archive
MEMBER
I'm creating a new branch `stream-tar-audio` just for the audio datasets since they need https://github.com/huggingface/datasets/pull/3129 to be merged first
2021-10-29T14:24:31Z
https://github.com/huggingface/datasets/pull/3110#issuecomment-954787563
https://api.github.com/repos/huggingface/datasets/issues/3110
IC_kwDODunzps446Obr
https://api.github.com/repos/huggingface/datasets/issues/comments/954787563/reactions
2021-10-29T14:32:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/954787563
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
The CI fails are only related to missing sections or tags in the dataset cards - which is unrelated to this PR
2021-11-05T15:39:14Z
https://github.com/huggingface/datasets/pull/3110#issuecomment-961999262
https://api.github.com/repos/huggingface/datasets/issues/3110
IC_kwDODunzps45VvGe
https://api.github.com/repos/huggingface/datasets/issues/comments/961999262/reactions
2021-11-05T15:39:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/961999262
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
I converted all the dataset based on TAR archive to use iter_archive instead, so that they can be streamable.

It means that around 80 datasets become streamable :)