Update Wikipedia dataset
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-03-04T08:24:24Z
https://github.com/huggingface/datasets/pull/3821#issuecomment-1058942487
https://api.github.com/repos/huggingface/datasets/issues/3821
IC_kwDODunzps4_Hi4X
https://api.github.com/repos/huggingface/datasets/issues/comments/1058942487/reactions
2022-03-21T12:35:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1058942487
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
I'm starting to generate the pre-processed data for some of the languages (for backward compatibility).

Once this merged, we will create the pre-processed data on the Hub under the Wikimedia namespace.
2022-03-04T14:36:59Z
https://github.com/huggingface/datasets/pull/3821#issuecomment-1059216743
https://api.github.com/repos/huggingface/datasets/issues/3821
IC_kwDODunzps4_Il1n
https://api.github.com/repos/huggingface/datasets/issues/comments/1059216743/reactions
2022-03-04T14:36:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1059216743
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
All steps have been properly done.

I'm merging all these commits into master.
2022-03-21T12:30:36Z
https://github.com/huggingface/datasets/pull/3821#issuecomment-1073834699
https://api.github.com/repos/huggingface/datasets/issues/3821
IC_kwDODunzps5AAWrL
https://api.github.com/repos/huggingface/datasets/issues/comments/1073834699/reactions
2022-03-21T12:30:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1073834699
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
This PR combines all updates to Wikipedia dataset.

Once approved, this will be used to generate the pre-processed Wikipedia datasets.

Finally, this PR will be able to be merged into master:
- NOT using squash
- BUT a regular MERGE (or REBASE+MERGE), so that all commits are preserved

TODO:
- [x] #3435
- [x] #3789
- [x] #3825
- [x] Run to get the pre-processed data for big languages (backward compatibility)
- [x] #3958

CC: @geohci