Add IC, SI, ER tasks to SUPERB
MEMBER
Sorry for the late PR, uploading 10+GB files to the hub through a VPN was an adventure :sweat_smile: 
2021-09-09T11:57:50Z
https://github.com/huggingface/datasets/pull/2884#issuecomment-916021807
https://api.github.com/repos/huggingface/datasets/issues/2884
IC_kwDODunzps42mWIv
https://api.github.com/repos/huggingface/datasets/issues/comments/916021807/reactions
2021-09-09T11:57:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/916021807
https://avatars.githubusercontent.com/u/26864830?v=4
https://api.github.com/users/anton-l/events{/privacy}
https://api.github.com/users/anton-l/followers
https://api.github.com/users/anton-l/following{/other_user}
https://api.github.com/users/anton-l/gists{/gist_id}
https://github.com/anton-l
anton-l
MDQ6VXNlcjI2ODY0ODMw
https://api.github.com/users/anton-l/orgs
https://api.github.com/users/anton-l/received_events
https://api.github.com/users/anton-l/repos
https://api.github.com/users/anton-l/starred{/owner}{/repo}
https://api.github.com/users/anton-l/subscriptions
User
https://api.github.com/users/anton-l
public
MEMBER
Thank you so much for adding these subsets @anton-l! 

> These datasets either require manual downloads or have broken/unstable links. You can get all necessary archives in this repo: https://huggingface.co/datasets/anton-l/superb_source_data_dumps/tree/main
Are we allowed to make these datasets public or would that violate the terms of their use?
2021-09-09T14:18:24Z
https://github.com/huggingface/datasets/pull/2884#issuecomment-916141964
https://api.github.com/repos/huggingface/datasets/issues/2884
IC_kwDODunzps42mzeM
https://api.github.com/repos/huggingface/datasets/issues/comments/916141964/reactions
2021-09-09T14:18:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/916141964
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
MEMBER
@lewtun These ones all have non-permissive licences, so the mirrored data I linked is open only to the HF org for now. But we could try contacting the authors to ask if they'd like to host these with us. 
For example VoxCeleb1 now has direct links (the ones in the script) that don't require form submission and passwords, but they ban IPs after each download for some reason :(
2021-09-09T15:12:26Z
https://github.com/huggingface/datasets/pull/2884#issuecomment-916191000
https://api.github.com/repos/huggingface/datasets/issues/2884
IC_kwDODunzps42m_cY
https://api.github.com/repos/huggingface/datasets/issues/comments/916191000/reactions
2021-09-09T15:12:26Z
https://api.github.com/repos/huggingface/datasets/issues/comments/916191000
https://avatars.githubusercontent.com/u/26864830?v=4
https://api.github.com/users/anton-l/events{/privacy}
https://api.github.com/users/anton-l/followers
https://api.github.com/users/anton-l/following{/other_user}
https://api.github.com/users/anton-l/gists{/gist_id}
https://github.com/anton-l
anton-l
MDQ6VXNlcjI2ODY0ODMw
https://api.github.com/users/anton-l/orgs
https://api.github.com/users/anton-l/received_events
https://api.github.com/users/anton-l/repos
https://api.github.com/users/anton-l/starred{/owner}{/repo}
https://api.github.com/users/anton-l/subscriptions
User
https://api.github.com/users/anton-l
public
MEMBER
> @lewtun These ones all have non-permissive licences, so the mirrored data I linked is open only to the HF org for now. But we could try contacting the authors to ask if they'd like to host these with us.
> For example VoxCeleb1 now has direct links (the ones in the script) that don't require form submission and passwords, but they ban IPs after each download for some reason :(

I think there would be a lot of value added if the authors would be willing to host their data on the HF Hub! As an end-user of `datasets`, I've found I'm more likely to explore a dataset if I'm able to quickly pull the subsets without needing a manual download. Perhaps we can tell them that the Hub offers several advantages like versioning and interactive exploration (with `datasets-viewer`)?
2021-09-13T09:16:09Z
https://github.com/huggingface/datasets/pull/2884#issuecomment-917998371
https://api.github.com/repos/huggingface/datasets/issues/2884
IC_kwDODunzps42t4sj
https://api.github.com/repos/huggingface/datasets/issues/comments/917998371/reactions
2021-09-13T09:16:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/917998371
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
This PR adds 3 additional classification tasks to SUPERB

#### Intent Classification
Dataset URL seems to be down at the moment :( See the note below.
S3PRL source: https://github.com/s3prl/s3prl/blob/master/s3prl/downstream/fluent_commands/dataset.py
Instructions: https://github.com/s3prl/s3prl/tree/master/s3prl/downstream#ic-intent-classification---fluent-speech-commands

#### Speaker Identification
Manual download script:
```
mkdir VoxCeleb1
cd VoxCeleb1
            
wget https://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partaa
wget https://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partab
wget https://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partac
wget https://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_dev_wav_partad
cat vox1_dev* > vox1_dev_wav.zip
unzip vox1_dev_wav.zip
            
wget https://thor.robots.ox.ac.uk/~vgg/data/voxceleb/vox1a/vox1_test_wav.zip
unzip vox1_test_wav.zip
            
# download the official SUPERB train-dev-test split
wget https://raw.githubusercontent.com/s3prl/s3prl/master/s3prl/downstream/voxceleb1/veri_test_class.txt
```
S3PRL source: https://github.com/s3prl/s3prl/blob/master/s3prl/downstream/voxceleb1/dataset.py
Instructions: https://github.com/s3prl/s3prl/tree/master/s3prl/downstream#sid-speaker-identification

#### Intent Classification
Manual download requires going through a slow application process, see the note below.
S3PRL source: https://github.com/s3prl/s3prl/blob/master/s3prl/downstream/emotion/IEMOCAP_preprocess.py
Instructions: https://github.com/s3prl/s3prl/tree/master/s3prl/downstream#er-emotion-recognition

#### :warning:  Note
These datasets either require manual downloads or have broken/unstable links. You can get all necessary archives in this repo: https://huggingface.co/datasets/anton-l/superb_source_data_dumps/tree/main