Add ability to load newer, cleaner version of Multi-News 
COLLABORATOR
Hi! Our versioning is based on Git revisions (the `revision` param in `load_dataset`), so you can just replace the old URL with the new one and open a PR :). I can also give you some pointers if needed.
2022-06-02T16:00:14Z
https://github.com/huggingface/datasets/issues/4430#issuecomment-1145032647
https://api.github.com/repos/huggingface/datasets/issues/4430
IC_kwDODunzps5EP8_H
https://api.github.com/repos/huggingface/datasets/issues/comments/1145032647/reactions
2022-06-02T16:00:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1145032647
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
@mariosasko Awesome thanks! I will do that. Looks like this new version of the data is not available as a zip but as three files (train/dev/test). How is this usually handled in HF Datasets, should `_URL` be a dict with keys `train`, `val`, `test` perhaps?
2022-06-02T18:02:11Z
https://github.com/huggingface/datasets/issues/4430#issuecomment-1145156930
https://api.github.com/repos/huggingface/datasets/issues/4430
IC_kwDODunzps5EQbVC
https://api.github.com/repos/huggingface/datasets/issues/comments/1145156930/reactions
2022-06-02T18:02:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1145156930
https://avatars.githubusercontent.com/u/8917831?v=4
https://api.github.com/users/JohnGiorgi/events{/privacy}
https://api.github.com/users/JohnGiorgi/followers
https://api.github.com/users/JohnGiorgi/following{/other_user}
https://api.github.com/users/JohnGiorgi/gists{/gist_id}
https://github.com/JohnGiorgi
JohnGiorgi
MDQ6VXNlcjg5MTc4MzE=
https://api.github.com/users/JohnGiorgi/orgs
https://api.github.com/users/JohnGiorgi/received_events
https://api.github.com/users/JohnGiorgi/repos
https://api.github.com/users/JohnGiorgi/starred{/owner}{/repo}
https://api.github.com/users/JohnGiorgi/subscriptions
User
https://api.github.com/users/JohnGiorgi
public
COLLABORATOR
Yes! Let me help you with more detailed instructions.

In the first step, we need to update the URLs. One of the possible dictionary structures is as follows:
```python
_URLs = {
    "train": {"src": "https://drive.google.com/uc?export=download&id=1wHAWDOwOoQWSj7HYpyJ3Aeud8WhhaJ7P", "tgt": "https://drive.google.com/uc?export=download&id=1QVgswwhVTkd3VLCzajK6eVkcrSWEK6kq"}
    "val": ...
    "test": ...
}
```

(You can use this page to generate direct download links: https://sites.google.com/site/gdocs2direct/)

Then we move to the `split_generators` method:
```python
def _split_generators(self, dl_manager):
    """Returns SplitGenerators."""
    files = dl_manager.download(_URLs)
    return [
        datasets.SplitGenerator(
            name=datasets.Split.TRAIN,
            gen_kwargs={"src_file": files["train"]["src"], "tgt_file": files["train"]["tgt"]},
        ),
        ... # same for val and test
    ]
```
Finally, we adjust the signature of `_generate_examples`:
```python
def _generate_examples(self, src_file, tgt_file):
     """Yields examples."""
     with open(src_file, encoding="utf-8") as src_f, open(
         tgt_file, encoding="utf-8"
     ) as tgt_f:
         ... # the rest is the same
```

And that's it!

PS: Let me know if you need help updating the dummy data and regenerating the metadata file.
2022-06-03T15:14:06Z
https://github.com/huggingface/datasets/issues/4430#issuecomment-1146063806
https://api.github.com/repos/huggingface/datasets/issues/4430
IC_kwDODunzps5ET4u-
https://api.github.com/repos/huggingface/datasets/issues/comments/1146063806/reactions
2022-06-03T15:14:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1146063806
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
Awesome! Thanks for the detailed help, that was straightforward with your instruction. However, I think I am being blocked by this issue: https://github.com/huggingface/datasets/issues/4428
2022-06-06T16:06:09Z
https://github.com/huggingface/datasets/issues/4430#issuecomment-1147619055
https://api.github.com/repos/huggingface/datasets/issues/4430
IC_kwDODunzps5EZ0bv
https://api.github.com/repos/huggingface/datasets/issues/comments/1147619055/reactions
2022-06-06T16:06:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1147619055
https://avatars.githubusercontent.com/u/8917831?v=4
https://api.github.com/users/JohnGiorgi/events{/privacy}
https://api.github.com/users/JohnGiorgi/followers
https://api.github.com/users/JohnGiorgi/following{/other_user}
https://api.github.com/users/JohnGiorgi/gists{/gist_id}
https://github.com/JohnGiorgi
JohnGiorgi
MDQ6VXNlcjg5MTc4MzE=
https://api.github.com/users/JohnGiorgi/orgs
https://api.github.com/users/JohnGiorgi/received_events
https://api.github.com/users/JohnGiorgi/repos
https://api.github.com/users/JohnGiorgi/starred{/owner}{/repo}
https://api.github.com/users/JohnGiorgi/subscriptions
User
https://api.github.com/users/JohnGiorgi
public
COLLABORATOR
Feel free to open a PR, and I can fix this manually.
2022-06-06T16:54:04Z
https://github.com/huggingface/datasets/issues/4430#issuecomment-1147664845
https://api.github.com/repos/huggingface/datasets/issues/4430
IC_kwDODunzps5EZ_nN
https://api.github.com/repos/huggingface/datasets/issues/comments/1147664845/reactions
2022-06-06T16:54:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1147664845
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
Awsome, done in #4451!
2022-06-06T16:57:47Z
https://github.com/huggingface/datasets/issues/4430#issuecomment-1147668250
https://api.github.com/repos/huggingface/datasets/issues/4430
IC_kwDODunzps5EaAca
https://api.github.com/repos/huggingface/datasets/issues/comments/1147668250/reactions
2022-06-06T16:57:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1147668250
https://avatars.githubusercontent.com/u/8917831?v=4
https://api.github.com/users/JohnGiorgi/events{/privacy}
https://api.github.com/users/JohnGiorgi/followers
https://api.github.com/users/JohnGiorgi/following{/other_user}
https://api.github.com/users/JohnGiorgi/gists{/gist_id}
https://github.com/JohnGiorgi
JohnGiorgi
MDQ6VXNlcjg5MTc4MzE=
https://api.github.com/users/JohnGiorgi/orgs
https://api.github.com/users/JohnGiorgi/received_events
https://api.github.com/users/JohnGiorgi/repos
https://api.github.com/users/JohnGiorgi/starred{/owner}{/repo}
https://api.github.com/users/JohnGiorgi/subscriptions
User
https://api.github.com/users/JohnGiorgi
public
**Is your feature request related to a problem? Please describe.**

The [Multi-News dataloader points to the original version of the Multi-News dataset](https://github.com/huggingface/datasets/blob/12540dd75015678ec6019f258d811ee107439a73/datasets/multi_news/multi_news.py#L47), but this has [known errors in it](https://github.com/Alex-Fabbri/Multi-News/issues/11). There exists a [newer version which fixes some of these issues](https://drive.google.com/open?id=1jwBzXBVv8sfnFrlzPnSUBHEEAbpIUnFq).

Unfortunately I don't think you can just replace this old URL with the new one, otherwise this could lead to issues with reproducibility.

**Describe the solution you'd like**

Add a new version to the Multi-News dataloader that points to the updated dataset which has fixes for some known issues.

**Describe alternatives you've considered**

Replace the current URL to the original version to the dataset with the URL to the version with fixes.

**Additional context**

Would be happy to make a PR for this, could someone maybe point me to another dataloader that has multiple versions so I can see how this is handled in `datasets`?
