Issue: Dataset download error
MEMBER
Hi @XuhuiZhou, thanks for reporting this issue. 

Indeed, the old links are no longer valid (404 Not Found error), and the script must be updated with the new links to Google Drive.
2021-03-18T09:05:04Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-801754364
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwMTc1NDM2NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/801754364/reactions
2021-03-18T09:05:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/801754364
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
It would be nice to update the urls indeed !

To do this, you just need to replace the urls in `iwslt2017.py` and then update the dataset_infos.json file with
```
datasets-cli test ./datasets/iwslt2017 --all_configs --save_infos --ignore_verifications
```
2021-03-18T09:18:52Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-801762991
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwMTc2Mjk5MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/801762991/reactions
2021-03-18T09:18:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/801762991
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Is this a command to update my local files or fix the file Github repo in general? (I am not so familiar with the datasets-cli command here)

I also took a brief look at the **Sharing your dataset** section, looks like I could fix that locally and push it to the repo? I guess we are "canonical" category?
2021-03-19T06:33:42Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-802592826
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwMjU5MjgyNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/802592826/reactions
2021-03-19T06:48:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/802592826
https://avatars.githubusercontent.com/u/20436061?v=4
https://api.github.com/users/XuhuiZhou/events{/privacy}
https://api.github.com/users/XuhuiZhou/followers
https://api.github.com/users/XuhuiZhou/following{/other_user}
https://api.github.com/users/XuhuiZhou/gists{/gist_id}
https://github.com/XuhuiZhou
XuhuiZhou
MDQ6VXNlcjIwNDM2MDYx
https://api.github.com/users/XuhuiZhou/orgs
https://api.github.com/users/XuhuiZhou/received_events
https://api.github.com/users/XuhuiZhou/repos
https://api.github.com/users/XuhuiZhou/starred{/owner}{/repo}
https://api.github.com/users/XuhuiZhou/subscriptions
User
https://api.github.com/users/XuhuiZhou
public
MEMBER
This command will update your local file. Then you can open a Pull Request to push your fix to the github repo :)
And yes you are right, it is a "canonical" dataset, i.e. a dataset script defined in this github repo (as opposed to dataset repositories of users on the huggingface hub)
2021-03-19T11:27:43Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-802764959
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwMjc2NDk1OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/802764959/reactions
2021-03-19T11:27:43Z
https://api.github.com/repos/huggingface/datasets/issues/comments/802764959
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hi, thanks for the answer. 

I gave a try to the problem today. But I encountered an upload error: 

```
git push -u origin fix_link_iwslt
Enter passphrase for key '/home2/xuhuizh/.ssh/id_rsa': 
ERROR: Permission to huggingface/datasets.git denied to XuhuiZhou.
fatal: Could not read from remote repository.

Please make sure you have the correct access rights
and the repository exists.
```

Any insight here? 

By the way, when I run the datasets-cli command, it shows the following error, but does not seem to be the error coming from `iwslt.py`

```
Traceback (most recent call last):
  File "/home2/xuhuizh/anaconda3/envs/UMT/bin/datasets-cli", line 33, in <module>
    sys.exit(load_entry_point('datasets', 'console_scripts', 'datasets-cli')())
  File "/home2/xuhuizh/projects/datasets/src/datasets/commands/datasets_cli.py", line 35, in main
    service.run()
  File "/home2/xuhuizh/projects/datasets/src/datasets/commands/test.py", line 141, in run
    try_from_hf_gcs=False,
  File "/home2/xuhuizh/projects/datasets/src/datasets/builder.py", line 579, in download_and_prepare
    dl_manager=dl_manager, verify_infos=verify_infos, **download_and_prepare_kwargs
  File "/home2/xuhuizh/projects/datasets/src/datasets/builder.py", line 639, in _download_and_prepare
    self.info.download_checksums, dl_manager.get_recorded_sizes_checksums(), "dataset source files"
  File "/home2/xuhuizh/projects/datasets/src/datasets/utils/info_utils.py", line 32, in verify_checksums
    raise ExpectedMoreDownloadedFiles(str(set(expected_checksums) - set(recorded_checksums)))
datasets.utils.info_utils.ExpectedMoreDownloadedFiles: {'https://wit3.fbk.eu/archive/2017-01-trnmted//texts/DeEnItNlRo/DeEnItNlRo/DeEnItNlRo-DeEnItNlRo.tgz'}
```
2021-03-20T06:13:39Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-803258399
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwMzI1ODM5OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/803258399/reactions
2021-03-20T06:13:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/803258399
https://avatars.githubusercontent.com/u/20436061?v=4
https://api.github.com/users/XuhuiZhou/events{/privacy}
https://api.github.com/users/XuhuiZhou/followers
https://api.github.com/users/XuhuiZhou/following{/other_user}
https://api.github.com/users/XuhuiZhou/gists{/gist_id}
https://github.com/XuhuiZhou
XuhuiZhou
MDQ6VXNlcjIwNDM2MDYx
https://api.github.com/users/XuhuiZhou/orgs
https://api.github.com/users/XuhuiZhou/received_events
https://api.github.com/users/XuhuiZhou/repos
https://api.github.com/users/XuhuiZhou/starred{/owner}{/repo}
https://api.github.com/users/XuhuiZhou/subscriptions
User
https://api.github.com/users/XuhuiZhou
public
MEMBER
Hi ! To create a PR on this repo your must fork it and create a branch on your fork. See how to fork the repo [here](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#start-by-preparing-your-environment).
And to make the command work without the `ExpectedMoreDownloadedFiles` error, you just need to use the `--ignore_verifications` flag.
2021-03-22T09:21:27Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-803904366
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwMzkwNDM2Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/803904366/reactions
2021-03-22T09:21:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/803904366
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Hi @XuhuiZhou,

As @lhoestq has well explained, you need to fork HF's repository, create a feature branch in your fork, push your changes to it and then open a Pull Request to HF's upstream repository. This is so because at HuggingFace Datasets we follow a development model called "Fork and Pull Model". You can find more information here:
- [Understanding the GitHub flow](https://guides.github.com/introduction/flow/)
- [Forking Projects](https://guides.github.com/activities/forking/)

Alternatively, if you find all these steps too complicated, you can use the GitHub official command line tool: [GitHub CLI](https://cli.github.com/). Once installed, in order to create a Pull Request, you only need to use this command:
```shell
gh pr create --web
```
This utility will automatically create the fork, push your changes and open a Pull Request, under the hood.
2021-03-22T11:52:31Z
https://github.com/huggingface/datasets/issues/2076#issuecomment-804003922
https://api.github.com/repos/huggingface/datasets/issues/2076
MDEyOklzc3VlQ29tbWVudDgwNDAwMzkyMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/804003922/reactions
2021-03-22T11:52:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/804003922
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
The download link in `iwslt2017.py` file does not seem to work anymore.

For example, `FileNotFoundError: Couldn't find file at https://wit3.fbk.eu/archive/2017-01-trnted/texts/zh/en/zh-en.tgz`

Would be nice if we could modify it script and use the new downloadable link?