[WIP][Common Voice 7] Add common voice 7.0
MEMBER
Hi ! I think the name `common_voice_7` is fine :)
Moreover if the dataset_infos.json is missing I'm pretty sure you don't need to specify `ignore_verifications=True`
2021-08-18T13:43:57Z
https://github.com/huggingface/datasets/pull/2771#issuecomment-901127044
https://api.github.com/repos/huggingface/datasets/issues/2771
IC_kwDODunzps41thuE
https://api.github.com/repos/huggingface/datasets/issues/comments/901127044/reactions
2021-08-18T13:43:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/901127044
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Hi, how about to add a new parameter "version" in the function load_dataset, something like: 
`load_dataset("common_voice", "lg", version="7.0") `
This is to avoid creating a new common_voice_? dataset (with almost the same code) every time 
Mozilla updates their Common Voice dataset.

2021-11-19T10:24:32Z
https://github.com/huggingface/datasets/pull/2771#issuecomment-973943336
https://api.github.com/repos/huggingface/datasets/issues/2771
IC_kwDODunzps46DTIo
https://api.github.com/repos/huggingface/datasets/issues/comments/973943336/reactions
2021-11-19T10:24:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/973943336
https://avatars.githubusercontent.com/u/7669893?v=4
https://api.github.com/users/cahya-wirawan/events{/privacy}
https://api.github.com/users/cahya-wirawan/followers
https://api.github.com/users/cahya-wirawan/following{/other_user}
https://api.github.com/users/cahya-wirawan/gists{/gist_id}
https://github.com/cahya-wirawan
cahya-wirawan
MDQ6VXNlcjc2Njk4OTM=
https://api.github.com/users/cahya-wirawan/orgs
https://api.github.com/users/cahya-wirawan/received_events
https://api.github.com/users/cahya-wirawan/repos
https://api.github.com/users/cahya-wirawan/starred{/owner}{/repo}
https://api.github.com/users/cahya-wirawan/subscriptions
User
https://api.github.com/users/cahya-wirawan
public
This PR allows to load the new common voice dataset manually as explained when doing: 

```python
from datasets import load_dataset

ds = load_dataset("./datasets/datasets/common_voice_7", "ab")
```

=>

```
                   Please follow the manual download instructions:

                     You need to manually the dataset from `https://commonvoice.mozilla.org/en/datasets`.
                     Make sure you choose the version `Common Voice Corpus 7.0`.
                     Choose a language of your choice and find the corresponding language-id, *e.g.*, `Abkhaz` with language-id `ab`. The following language-ids are available:

                     ['ab', 'ar', 'as', 'az', 'ba', 'bas', 'be', 'bg', 'br', 'ca', 'cnh', 'cs', 'cv', 'cy', 'de', 'dv', 'el', 'en', 'eo', 'es', 'et', 'eu', 'fa', 'fi', 'fr', 'fy-NL', 'ga-IE', 'gl', 'gn', 'ha', 'hi', 'hsb', 'hu', 'hy-AM', 'ia', 'id', 'it', 'ja', 'ka', 'kab', 'kk', 'kmr', 'ky', 'lg', 'lt', 'lv', 'mn', 'mt', 'nl', 'or', 'pa-IN', 'pl', 'pt', 'rm-sursilv', 'rm-vallader', 'ro', 'ru', 'rw', 'sah', 'sk', 'sl', 'sr', 'sv-SE', 'ta', 'th', 'tr', 'tt', 'ug', 'uk', 'ur', 'uz', 'vi', 'vot', 'zh-CN', 'zh-HK', 'zh-TW']

                     Next, you will have to enter your email address to download the dataset in the `tar.gz` format. Save the file under <path-to-file>.
                     The file should then be extracted with: ``tar -xvzf <path-to-file>`` which will extract a folder called ``cv-corpus-7.0-2021-07-21``.
                     The dataset can then be loaded with `datasets.load_dataset("common_voice", <language-id>, data_dir="<path-to-'cv-corpus-7.0-2021-07-21'-folder>", ignore_verifications=True).
```

Having followed those instructions one can then download the data as follows: 

```python
from datasets import load_dataset

ds = load_dataset("./datasets/datasets/common_voice_7", "ab", data_dir="./cv-corpus-7.0-2021-07-21/", ignore_verifications=True)
```

## TODO
- [ ] Discuss naming. Is the name ok here "common_voice_7"? The dataset script differs only really in one point from `common_voice.py` in that all the metadata is different (more hours etc...) and that it has to use manual data dir for now
- [ ] Ideally we should get a bundled download link. For `common_voice.py` there is a bundled download link: `https://voice-prod-bundler-ee1969a6ce8178826482b88e843c335139bd3fb4.s3.amazonaws.com/cv-corpus-6.1-2020-12-11/{}.tar.gz` that allows one to directly download the data. However such a link is missing for Common Voice 7. I guess we should try to contact common voice about it and ask whether we could host the data or help otherwise somehow. See: https://github.com/common-voice/common-voice-bundler/issues/15 cc @yjernite 
- [ ] I did not compute the dataset.json and it would mean that I'd have to download 76 datasets totalling around 1TB manually before running the checksum command. This just takes too much time. For now the user will have to add a `ignore_verifications=True` to download the data. This step would also be much easier if we could get a bundled link
- [ ] Add dummy data