🐛 [Dataset] Cannot download wmt14, wmt15 and wmt17
NONE
similar slow download speed here for nlp.load_dataset('wmt14', 'fr-en')
`
Downloading: 100%|██████████████████████████████████████████████████████████| 658M/658M [1:00:42<00:00, 181kB/s]
Downloading: 100%|██████████████████████████████████████████████████████████| 918M/918M [1:39:38<00:00, 154kB/s]
Downloading:   2%|▉                                                       | 40.9M/2.37G [04:48<5:03:06, 128kB/s]
`
Could we just download a specific subdataset in 'wmt14', such as 'newstest14'? 
2020-07-15T11:31:38Z
https://github.com/huggingface/datasets/issues/388#issuecomment-658715255
https://api.github.com/repos/huggingface/datasets/issues/388
MDEyOklzc3VlQ29tbWVudDY1ODcxNTI1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/658715255/reactions
2020-07-15T11:33:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/658715255
https://avatars.githubusercontent.com/u/8700683?v=4
https://api.github.com/users/ericaliu0610/events{/privacy}
https://api.github.com/users/ericaliu0610/followers
https://api.github.com/users/ericaliu0610/following{/other_user}
https://api.github.com/users/ericaliu0610/gists{/gist_id}
https://github.com/ericaliu0610
ericaliu0610
MDQ6VXNlcjg3MDA2ODM=
https://api.github.com/users/ericaliu0610/orgs
https://api.github.com/users/ericaliu0610/received_events
https://api.github.com/users/ericaliu0610/repos
https://api.github.com/users/ericaliu0610/starred{/owner}{/repo}
https://api.github.com/users/ericaliu0610/subscriptions
User
https://api.github.com/users/ericaliu0610
public
MEMBER
> The code runs but the download speed is extremely slow, the same behaviour is not observed on wmt16 and wmt18

The original source for the files may provide slow download speeds.
We can probably host these files ourselves.

> When trying to download wmt17 zh-en, I got the following error:
> ConnectionError: Couldn't reach https://storage.googleapis.com/tfdataset-data/downloadataset/uncorpus/UNv1.0.en-zh.tar.gz

Looks like the file`UNv1.0.en-zh.tar.gz` is missing, or the url changed. We need to fix that

> Could we just download a specific subdataset in 'wmt14', such as 'newstest14'?

Right now I don't think it's possible. Maybe @patrickvonplaten knows more about it

2020-07-17T11:35:24Z
https://github.com/huggingface/datasets/issues/388#issuecomment-660058607
https://api.github.com/repos/huggingface/datasets/issues/388
MDEyOklzc3VlQ29tbWVudDY2MDA1ODYwNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/660058607/reactions
2020-07-17T11:35:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/660058607
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Yeah, the download speed is sadly always extremely slow :-/. 
I will try to check out the `wmt17 zh-en` bug :-) 
2020-07-17T12:01:15Z
https://github.com/huggingface/datasets/issues/388#issuecomment-660069449
https://api.github.com/repos/huggingface/datasets/issues/388
MDEyOklzc3VlQ29tbWVudDY2MDA2OTQ0OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/660069449/reactions
2020-07-17T12:01:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/660069449
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
NONE
Maybe this can be used - https://stuncorpusprod.blob.core.windows.net/corpusfiles/UNv1.0.en-zh.tar.gz.00 
2020-07-22T06:24:10Z
https://github.com/huggingface/datasets/issues/388#issuecomment-662267183
https://api.github.com/repos/huggingface/datasets/issues/388
MDEyOklzc3VlQ29tbWVudDY2MjI2NzE4Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/662267183/reactions
2020-07-22T06:24:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/662267183
https://avatars.githubusercontent.com/u/42022935?v=4
https://api.github.com/users/kalyangvs/events{/privacy}
https://api.github.com/users/kalyangvs/followers
https://api.github.com/users/kalyangvs/following{/other_user}
https://api.github.com/users/kalyangvs/gists{/gist_id}
https://github.com/kalyangvs
kalyangvs
MDQ6VXNlcjQyMDIyOTM1
https://api.github.com/users/kalyangvs/orgs
https://api.github.com/users/kalyangvs/received_events
https://api.github.com/users/kalyangvs/repos
https://api.github.com/users/kalyangvs/starred{/owner}{/repo}
https://api.github.com/users/kalyangvs/subscriptions
User
https://api.github.com/users/kalyangvs
public
COLLABORATOR
These issues seem to be fixed now.
2022-10-04T18:01:28Z
https://github.com/huggingface/datasets/issues/388#issuecomment-1267363099
https://api.github.com/repos/huggingface/datasets/issues/388
IC_kwDODunzps5Lim0b
https://api.github.com/repos/huggingface/datasets/issues/comments/1267363099/reactions
2022-10-04T18:01:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1267363099
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
1. I try downloading `wmt14`, `wmt15`, `wmt17`, `wmt19` with the following code:
```
nlp.load_dataset('wmt14','de-en')
nlp.load_dataset('wmt15','de-en')
nlp.load_dataset('wmt17','de-en')
nlp.load_dataset('wmt19','de-en')
```
The code runs but the download speed is **extremely slow**, the same behaviour is not observed on `wmt16` and `wmt18`

2. When trying to download `wmt17 zh-en`, I got the following error:
> ConnectionError: Couldn't reach https://storage.googleapis.com/tfdataset-data/downloadataset/uncorpus/UNv1.0.en-zh.tar.gz