[GH->HF] Part 2: Remove all dataset scripts from github
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-09-13T16:05:55Z
https://github.com/huggingface/datasets/pull/4974#issuecomment-1245626322
https://api.github.com/repos/huggingface/datasets/issues/4974
IC_kwDODunzps5KPr_S
https://api.github.com/repos/huggingface/datasets/issues/comments/1245626322/reactions
2022-10-03T17:09:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1245626322
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
So this means metrics will be deleted from this repo in favor of the "evaluate" library? Maybe you guys could just redirect metrics to that library.
2022-09-18T18:57:05Z
https://github.com/huggingface/datasets/pull/4974#issuecomment-1250366847
https://api.github.com/repos/huggingface/datasets/issues/4974
IC_kwDODunzps5KhxV_
https://api.github.com/repos/huggingface/datasets/issues/comments/1250366847/reactions
2022-09-18T18:57:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1250366847
https://avatars.githubusercontent.com/u/74963545?v=4
https://api.github.com/users/osbm/events{/privacy}
https://api.github.com/users/osbm/followers
https://api.github.com/users/osbm/following{/other_user}
https://api.github.com/users/osbm/gists{/gist_id}
https://github.com/osbm
osbm
MDQ6VXNlcjc0OTYzNTQ1
https://api.github.com/users/osbm/orgs
https://api.github.com/users/osbm/received_events
https://api.github.com/users/osbm/repos
https://api.github.com/users/osbm/starred{/owner}{/repo}
https://api.github.com/users/osbm/subscriptions
User
https://api.github.com/users/osbm
public
MEMBER
We are deprecating the metrics in `datasets` indeed and suggest users to switch to `evaluate` (via a warning message)

We'll keep the current metrics as they are for now, but they'll be completely removed at one point
2022-09-19T10:17:26Z
https://github.com/huggingface/datasets/pull/4974#issuecomment-1250830986
https://api.github.com/repos/huggingface/datasets/issues/4974
IC_kwDODunzps5KjiqK
https://api.github.com/repos/huggingface/datasets/issues/comments/1250830986/reactions
2022-09-19T10:17:26Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1250830986
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
I guess this is ready to merge ?

It should break nothing except one rare case:

If someone is using an old version of `datasets` to try to load a recent dataset. Indeed in that case it fetches the `main` branch on github to see if it exists. But since we're removing all the datasets, forward fetching won't work anymore.

e.g. if someone uses "imagenet-1k" with a version of `datasets` that didn't have it at that time. I checked on kibana and one single user would be affected with 4k downloads/months. It should still work for them though thanks to the `datasets` cache

But if they delete their cache, the workaround is... 🥁 update `datasets` 😅
2022-09-22T13:08:12Z
https://github.com/huggingface/datasets/pull/4974#issuecomment-1254999345
https://api.github.com/repos/huggingface/datasets/issues/4974
IC_kwDODunzps5KzcUx
https://api.github.com/repos/huggingface/datasets/issues/comments/1254999345/reactions
2022-09-22T13:18:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1254999345
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Let's merge this on monday if we can, to make sure contributors who wanted to merge their dataset PRs here could do it
2022-09-30T08:52:08Z
https://github.com/huggingface/datasets/pull/4974#issuecomment-1263297207
https://api.github.com/repos/huggingface/datasets/issues/4974
IC_kwDODunzps5LTGK3
https://api.github.com/repos/huggingface/datasets/issues/comments/1263297207/reactions
2022-09-30T08:52:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1263297207
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Alright, merging !
2022-10-03T17:07:24Z
https://github.com/huggingface/datasets/pull/4974#issuecomment-1265762559
https://api.github.com/repos/huggingface/datasets/issues/4974
IC_kwDODunzps5LcgD_
https://api.github.com/repos/huggingface/datasets/issues/comments/1265762559/reactions
2022-10-03T17:07:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1265762559
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Now that all the datasets live on the Hub we can remove the /datasets directory that contains all the dataset scripts of this repository

- [x] Needs https://github.com/huggingface/datasets/pull/4973 to be merged first
- [x] and PR to be enabled on the Hub for non-namespaced datasets