Warn about checksums
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-11-22T11:04:29Z
https://github.com/huggingface/datasets/pull/5279#issuecomment-1323496496
https://api.github.com/repos/huggingface/datasets/issues/5279
IC_kwDODunzps5O4vQw
https://api.github.com/repos/huggingface/datasets/issues/comments/1323496496/reactions
2022-11-23T09:50:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1323496496
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
I'm also in favor of disabling this by default - it's kinda impractical
2022-11-23T09:12:39Z
https://github.com/huggingface/datasets/pull/5279#issuecomment-1324748331
https://api.github.com/repos/huggingface/datasets/issues/5279
IC_kwDODunzps5O9g4r
https://api.github.com/repos/huggingface/datasets/issues/comments/1324748331/reactions
2022-11-23T09:12:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1324748331
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Great, thanks for the quick turnaround on this!
2022-11-23T11:43:49Z
https://github.com/huggingface/datasets/pull/5279#issuecomment-1324928006
https://api.github.com/repos/huggingface/datasets/issues/5279
IC_kwDODunzps5O-MwG
https://api.github.com/repos/huggingface/datasets/issues/comments/1324928006/reactions
2022-11-23T11:43:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1324928006
https://avatars.githubusercontent.com/u/1528523?v=4
https://api.github.com/users/ola13/events{/privacy}
https://api.github.com/users/ola13/followers
https://api.github.com/users/ola13/following{/other_user}
https://api.github.com/users/ola13/gists{/gist_id}
https://github.com/ola13
ola13
MDQ6VXNlcjE1Mjg1MjM=
https://api.github.com/users/ola13/orgs
https://api.github.com/users/ola13/received_events
https://api.github.com/users/ola13/repos
https://api.github.com/users/ola13/starred{/owner}{/repo}
https://api.github.com/users/ola13/subscriptions
User
https://api.github.com/users/ola13
public
It takes a lot of time on big datasets to compute the checksums, we should at least add a warning to notify the user about this step. I also mentioned how to disable it, and added a tqdm bar (delay=5 seconds)

cc @ola13 