Zenodo.org download is not responding
MEMBER
[Off topic but related: Is the uptime of S3 provably better than Zenodo's?]
2022-04-19T13:01:44Z
https://github.com/huggingface/datasets/issues/4182#issuecomment-1102624741
https://api.github.com/repos/huggingface/datasets/issues/4182
IC_kwDODunzps5BuLfl
https://api.github.com/repos/huggingface/datasets/issues/comments/1102624741/reactions
2022-04-19T13:01:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1102624741
https://avatars.githubusercontent.com/u/326577?v=4
https://api.github.com/users/julien-c/events{/privacy}
https://api.github.com/users/julien-c/followers
https://api.github.com/users/julien-c/following{/other_user}
https://api.github.com/users/julien-c/gists{/gist_id}
https://github.com/julien-c
julien-c
MDQ6VXNlcjMyNjU3Nw==
https://api.github.com/users/julien-c/orgs
https://api.github.com/users/julien-c/received_events
https://api.github.com/users/julien-c/repos
https://api.github.com/users/julien-c/starred{/owner}{/repo}
https://api.github.com/users/julien-c/subscriptions
User
https://api.github.com/users/julien-c
public
MEMBER
Hi @dkajtoch, please note that at HuggingFace we are not hosting this dataset: we are just using a script to download their data file and create a dataset from it.

It was the dataset owners decision to host their data at Zenodo. You can see this on their website: https://marcobaroni.org/composes/sick.html

And yes, you are right: Zenodo is currently having some incidents and people are reporting problems from it.

On the other hand, we could contact the data owners and propose them to host their data at our Hugging Face Hub.

@julien-c I guess so.

2022-04-19T15:25:58Z
https://github.com/huggingface/datasets/issues/4182#issuecomment-1102789643
https://api.github.com/repos/huggingface/datasets/issues/4182
IC_kwDODunzps5BuzwL
https://api.github.com/repos/huggingface/datasets/issues/comments/1102789643/reactions
2022-04-19T15:25:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1102789643
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
CONTRIBUTOR
Thanks @albertvillanova. I know that the problem lies in the source data. I just wanted to point out that these kind of problems are unavoidable without having one place where data sources are cached. Websites may go down or data sources may move. Having a copy in Hugging Face Hub would be a great solution. 
2022-04-19T15:50:54Z
https://github.com/huggingface/datasets/issues/4182#issuecomment-1102815804
https://api.github.com/repos/huggingface/datasets/issues/4182
IC_kwDODunzps5Bu6I8
https://api.github.com/repos/huggingface/datasets/issues/comments/1102815804/reactions
2022-04-19T15:50:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1102815804
https://avatars.githubusercontent.com/u/32985207?v=4
https://api.github.com/users/dkajtoch/events{/privacy}
https://api.github.com/users/dkajtoch/followers
https://api.github.com/users/dkajtoch/following{/other_user}
https://api.github.com/users/dkajtoch/gists{/gist_id}
https://github.com/dkajtoch
dkajtoch
MDQ6VXNlcjMyOTg1MjA3
https://api.github.com/users/dkajtoch/orgs
https://api.github.com/users/dkajtoch/received_events
https://api.github.com/users/dkajtoch/repos
https://api.github.com/users/dkajtoch/starred{/owner}{/repo}
https://api.github.com/users/dkajtoch/subscriptions
User
https://api.github.com/users/dkajtoch
public
MEMBER
Definitely, @dkajtoch! But we have to ask permission to the data owners. And many dataset licenses directly forbid data redistribution: in those cases we are not allowed to host their data on our Hub.
2022-04-19T16:02:32Z
https://github.com/huggingface/datasets/issues/4182#issuecomment-1102827462
https://api.github.com/repos/huggingface/datasets/issues/4182
IC_kwDODunzps5Bu8_G
https://api.github.com/repos/huggingface/datasets/issues/comments/1102827462/reactions
2022-04-19T16:02:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1102827462
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
CONTRIBUTOR
Ahhh good point! License is the problem :(
2022-04-19T16:07:46Z
https://github.com/huggingface/datasets/issues/4182#issuecomment-1102832738
https://api.github.com/repos/huggingface/datasets/issues/4182
IC_kwDODunzps5Bu-Ri
https://api.github.com/repos/huggingface/datasets/issues/comments/1102832738/reactions
2022-04-19T16:07:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1102832738
https://avatars.githubusercontent.com/u/32985207?v=4
https://api.github.com/users/dkajtoch/events{/privacy}
https://api.github.com/users/dkajtoch/followers
https://api.github.com/users/dkajtoch/following{/other_user}
https://api.github.com/users/dkajtoch/gists{/gist_id}
https://github.com/dkajtoch
dkajtoch
MDQ6VXNlcjMyOTg1MjA3
https://api.github.com/users/dkajtoch/orgs
https://api.github.com/users/dkajtoch/received_events
https://api.github.com/users/dkajtoch/repos
https://api.github.com/users/dkajtoch/starred{/owner}{/repo}
https://api.github.com/users/dkajtoch/subscriptions
User
https://api.github.com/users/dkajtoch
public
## Describe the bug
Source download_url from zenodo.org does not respond. 
`_DOWNLOAD_URL = "https://zenodo.org/record/2787612/files/SICK.zip?download=1"`
Other datasets also use zenodo.org to store data and they cannot be downloaded as well.

It would be better to actually use more reliable way to store original data like s3 bucket.

## Steps to reproduce the bug
```python
load_dataset("sick")
```

## Expected results
Dataset should be downloaded.

## Actual results
ConnectionError: Couldn't reach https://zenodo.org/record/2787612/files/SICK.zip?download=1 (ReadTimeout(ReadTimeoutError("HTTPSConnectionPool(host='zenodo.org', port=443): Read timed out. (read timeout=100)")))

## Environment info
- `datasets` version: 2.1.0
- Platform: Darwin-21.4.0-x86_64-i386-64bit
- Python version: 3.7.11
- PyArrow version: 7.0.0
- Pandas version: 1.3.5
