Add common voice
CONTRIBUTOR
I have started working on adding this dataset.
2021-02-12T08:09:25Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-778045229
https://api.github.com/repos/huggingface/datasets/issues/1840
MDEyOklzc3VlQ29tbWVudDc3ODA0NTIyOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/778045229/reactions
2021-02-12T08:09:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/778045229
https://avatars.githubusercontent.com/u/1704131?v=4
https://api.github.com/users/BirgerMoell/events{/privacy}
https://api.github.com/users/BirgerMoell/followers
https://api.github.com/users/BirgerMoell/following{/other_user}
https://api.github.com/users/BirgerMoell/gists{/gist_id}
https://github.com/BirgerMoell
BirgerMoell
MDQ6VXNlcjE3MDQxMzE=
https://api.github.com/users/BirgerMoell/orgs
https://api.github.com/users/BirgerMoell/received_events
https://api.github.com/users/BirgerMoell/repos
https://api.github.com/users/BirgerMoell/starred{/owner}{/repo}
https://api.github.com/users/BirgerMoell/subscriptions
User
https://api.github.com/users/BirgerMoell
public
CONTRIBUTOR
Hey @BirgerMoell - awesome that you started working on Common Voice. Common Voice is a bit special since, there is no direct download link to download the data. In these cases we usually consider two options:

1) Find a hacky solution to extract the download link somehow from the XLM tree of the website 
2) If this doesn't work we force the user to download the data himself and add a `"data_dir"` as an input parameter. E.g. you can take a look at how it is done for [this](https://github.com/huggingface/datasets/blob/66f2a7eece98d2778bd22bb5034cb7c2376032d4/datasets/arxiv_dataset/arxiv_dataset.py#L66) 

Also the documentation here: https://huggingface.co/docs/datasets/add_dataset.html?highlight=data_dir#downloading-data-files-and-organizing-splits (especially the "note") might be helpful.
2021-02-15T05:06:24Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-778941339
https://api.github.com/repos/huggingface/datasets/issues/1840
MDEyOklzc3VlQ29tbWVudDc3ODk0MTMzOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/778941339/reactions
2021-02-15T05:06:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/778941339
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
Let me know if you have any other questions
2021-02-15T05:06:34Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-778941421
https://api.github.com/repos/huggingface/datasets/issues/1840
MDEyOklzc3VlQ29tbWVudDc3ODk0MTQyMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/778941421/reactions
2021-02-15T05:06:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/778941421
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
I added a Work in Progress pull request (hope that is ok). I've made a card for the dataset and filled out the common_voice.py file with information about the datset (not completely).

I didn't manage to get the tagging tool working locally on my machine but will look into that later.

Left to do.

- Tag the dataset
- Add missing information and update common_voice.py

https://github.com/huggingface/datasets/pull/1886
2021-02-16T11:18:26Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-779770683
https://api.github.com/repos/huggingface/datasets/issues/1840
MDEyOklzc3VlQ29tbWVudDc3OTc3MDY4Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/779770683/reactions
2021-02-16T11:18:26Z
https://api.github.com/repos/huggingface/datasets/issues/comments/779770683
https://avatars.githubusercontent.com/u/1704131?v=4
https://api.github.com/users/BirgerMoell/events{/privacy}
https://api.github.com/users/BirgerMoell/followers
https://api.github.com/users/BirgerMoell/following{/other_user}
https://api.github.com/users/BirgerMoell/gists{/gist_id}
https://github.com/BirgerMoell
BirgerMoell
MDQ6VXNlcjE3MDQxMzE=
https://api.github.com/users/BirgerMoell/orgs
https://api.github.com/users/BirgerMoell/received_events
https://api.github.com/users/BirgerMoell/repos
https://api.github.com/users/BirgerMoell/starred{/owner}{/repo}
https://api.github.com/users/BirgerMoell/subscriptions
User
https://api.github.com/users/BirgerMoell
public
CONTRIBUTOR
Awesome! I left a longer comment on the PR :-)
2021-02-16T15:32:52Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-779914655
https://api.github.com/repos/huggingface/datasets/issues/1840
MDEyOklzc3VlQ29tbWVudDc3OTkxNDY1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/779914655/reactions
2021-02-16T15:32:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/779914655
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
NONE
I saw that this current datasets package holds common voice version 6.1, how to add the new version 7.0 that is already available?
2021-09-24T08:53:07Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-926460884
https://api.github.com/repos/huggingface/datasets/issues/1840
IC_kwDODunzps43OKvU
https://api.github.com/repos/huggingface/datasets/issues/comments/926460884/reactions
2021-09-24T08:53:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/926460884
https://avatars.githubusercontent.com/u/3158361?v=4
https://api.github.com/users/bagustris/events{/privacy}
https://api.github.com/users/bagustris/followers
https://api.github.com/users/bagustris/following{/other_user}
https://api.github.com/users/bagustris/gists{/gist_id}
https://github.com/bagustris
bagustris
MDQ6VXNlcjMxNTgzNjE=
https://api.github.com/users/bagustris/orgs
https://api.github.com/users/bagustris/received_events
https://api.github.com/users/bagustris/repos
https://api.github.com/users/bagustris/starred{/owner}{/repo}
https://api.github.com/users/bagustris/subscriptions
User
https://api.github.com/users/bagustris
public
CONTRIBUTOR
Will me merged next week - we're working on it :-)
2021-09-24T09:05:10Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-926468690
https://api.github.com/repos/huggingface/datasets/issues/1840
IC_kwDODunzps43OMpS
https://api.github.com/repos/huggingface/datasets/issues/comments/926468690/reactions
2021-09-24T09:05:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/926468690
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
NONE
Common voice still appears to be a 6.1. Is the plan still to upgrade to 7.0?
2021-12-31T13:48:16Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-1003380985
https://api.github.com/repos/huggingface/datasets/issues/1840
IC_kwDODunzps47zmD5
https://api.github.com/repos/huggingface/datasets/issues/comments/1003380985/reactions
2021-12-31T13:48:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1003380985
https://avatars.githubusercontent.com/u/29051594?v=4
https://api.github.com/users/pjbbuzz61/events{/privacy}
https://api.github.com/users/pjbbuzz61/followers
https://api.github.com/users/pjbbuzz61/following{/other_user}
https://api.github.com/users/pjbbuzz61/gists{/gist_id}
https://github.com/pjbbuzz61
pjbbuzz61
MDQ6VXNlcjI5MDUxNTk0
https://api.github.com/users/pjbbuzz61/orgs
https://api.github.com/users/pjbbuzz61/received_events
https://api.github.com/users/pjbbuzz61/repos
https://api.github.com/users/pjbbuzz61/starred{/owner}{/repo}
https://api.github.com/users/pjbbuzz61/subscriptions
User
https://api.github.com/users/pjbbuzz61
public
CONTRIBUTOR
We actually already have the code and everything ready to add Common Voice 7.0 to `datasets` but are still waiting for the common voice authors to give us the green light :-) 

Also gently pinging @phirework and @milupo here
2022-01-03T09:17:58Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-1003959759
https://api.github.com/repos/huggingface/datasets/issues/1840
IC_kwDODunzps471zXP
https://api.github.com/repos/huggingface/datasets/issues/comments/1003959759/reactions
2022-01-03T09:17:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1003959759
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
Common Voice 7.0 is available here now: https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0
2022-01-05T16:19:51Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-1005871054
https://api.github.com/repos/huggingface/datasets/issues/1840
IC_kwDODunzps479F_O
https://api.github.com/repos/huggingface/datasets/issues/comments/1005871054/reactions
2022-01-05T16:19:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1005871054
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
NONE
For anyone else stumbling upon this thread, the 8.0 version is also available now: https://huggingface.co/datasets/mozilla-foundation/common_voice_8_0
2022-03-20T15:23:29Z
https://github.com/huggingface/datasets/issues/1840#issuecomment-1073274238
https://api.github.com/repos/huggingface/datasets/issues/1840
IC_kwDODunzps4_-N1-
https://api.github.com/repos/huggingface/datasets/issues/comments/1073274238/reactions
2022-03-20T15:23:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1073274238
https://avatars.githubusercontent.com/u/23178145?v=4
https://api.github.com/users/bfelbo/events{/privacy}
https://api.github.com/users/bfelbo/followers
https://api.github.com/users/bfelbo/following{/other_user}
https://api.github.com/users/bfelbo/gists{/gist_id}
https://github.com/bfelbo
bfelbo
MDQ6VXNlcjIzMTc4MTQ1
https://api.github.com/users/bfelbo/orgs
https://api.github.com/users/bfelbo/received_events
https://api.github.com/users/bfelbo/repos
https://api.github.com/users/bfelbo/starred{/owner}{/repo}
https://api.github.com/users/bfelbo/subscriptions
User
https://api.github.com/users/bfelbo
public
## Adding a Dataset
- **Name:** *common voice*
- **Description:** *Mozilla Common Voice Dataset*
- **Paper:** Homepage: https://voice.mozilla.org/en/datasets
- **Data:** https://voice.mozilla.org/en/datasets
- **Motivation:** Important speech dataset
- **TFDatasets Implementation**: https://www.tensorflow.org/datasets/catalog/common_voice
If interested in tackling this issue, feel free to tag @patrickvonplaten

Instructions to add a new dataset can be found [here](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md).
