Add VoxPopuli
NONE
I'm happy to take this on:) One question: The original unlabelled data is stored unsegmented (see e.g. https://github.com/facebookresearch/voxpopuli/blob/main/voxpopuli/get_unlabelled_data.py#L30), but segmenting the audio in the dataset would require a dependency on something like soundfile or torchaudio. An alternative could be to provide the segments start and end times as a Sequence and then it's up to the user to perform the segmentation on-the-fly if they wish?
2021-05-07T22:18:16Z
https://github.com/huggingface/datasets/issues/2300#issuecomment-834819595
https://api.github.com/repos/huggingface/datasets/issues/2300
MDEyOklzc3VlQ29tbWVudDgzNDgxOTU5NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/834819595/reactions
2021-05-07T22:18:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/834819595
https://avatars.githubusercontent.com/u/2356937?v=4
https://api.github.com/users/jfainberg/events{/privacy}
https://api.github.com/users/jfainberg/followers
https://api.github.com/users/jfainberg/following{/other_user}
https://api.github.com/users/jfainberg/gists{/gist_id}
https://github.com/jfainberg
jfainberg
MDQ6VXNlcjIzNTY5Mzc=
https://api.github.com/users/jfainberg/orgs
https://api.github.com/users/jfainberg/received_events
https://api.github.com/users/jfainberg/repos
https://api.github.com/users/jfainberg/starred{/owner}{/repo}
https://api.github.com/users/jfainberg/subscriptions
User
https://api.github.com/users/jfainberg
public
CONTRIBUTOR
Hey @jfainberg,

This sounds great! I think adding a dependency would not be a big problem, however automatically segmenting the data probably means that it would take a very long time to do:

```python
dataset = load_dataset("voxpopuli", "french")
```

=> so as a start I think your option 2 is the way to go!
2021-05-13T10:31:52Z
https://github.com/huggingface/datasets/issues/2300#issuecomment-840470500
https://api.github.com/repos/huggingface/datasets/issues/2300
MDEyOklzc3VlQ29tbWVudDg0MDQ3MDUwMA==
https://api.github.com/repos/huggingface/datasets/issues/comments/840470500/reactions
2021-05-13T10:31:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/840470500
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
COLLABORATOR
@polinaeterna VoxPopuli is available [here](https://huggingface.co/datasets/facebook/voxpopuli), so we can close this issue, right?

2023-02-28T16:33:00Z
https://github.com/huggingface/datasets/issues/2300#issuecomment-1448488830
https://api.github.com/repos/huggingface/datasets/issues/2300
IC_kwDODunzps5WVi9-
https://api.github.com/repos/huggingface/datasets/issues/comments/1448488830/reactions
2023-02-28T16:33:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1448488830
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
@mariosasko yes, sure, closing it
2023-02-28T17:43:51Z
https://github.com/huggingface/datasets/issues/2300#issuecomment-1448602057
https://api.github.com/repos/huggingface/datasets/issues/2300
IC_kwDODunzps5WV-nJ
https://api.github.com/repos/huggingface/datasets/issues/comments/1448602057/reactions
2023-02-28T17:43:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1448602057
https://avatars.githubusercontent.com/u/16348744?v=4
https://api.github.com/users/polinaeterna/events{/privacy}
https://api.github.com/users/polinaeterna/followers
https://api.github.com/users/polinaeterna/following{/other_user}
https://api.github.com/users/polinaeterna/gists{/gist_id}
https://github.com/polinaeterna
polinaeterna
MDQ6VXNlcjE2MzQ4NzQ0
https://api.github.com/users/polinaeterna/orgs
https://api.github.com/users/polinaeterna/received_events
https://api.github.com/users/polinaeterna/repos
https://api.github.com/users/polinaeterna/starred{/owner}{/repo}
https://api.github.com/users/polinaeterna/subscriptions
User
https://api.github.com/users/polinaeterna
public
## Adding a Dataset
- **Name:** Voxpopuli
- **Description:** VoxPopuli is raw data is collected from 2009-2020 European Parliament event recordings
- **Paper:** https://arxiv.org/abs/2101.00390
- **Data:** https://github.com/facebookresearch/voxpopuli
- **Motivation:** biggest unlabeled speech dataset

**Note**: Since the dataset is so huge, we should only add the config `10k` in the beginning.

Instructions to add a new dataset can be found [here](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md).
