Added XL-Sum dataset
MEMBER
Thanks for adding this one ! I just did some minor changes and set the timeout back to 100sec instead of 1000
2021-08-31T14:48:38Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-909308315
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42MvGb
https://api.github.com/repos/huggingface/datasets/issues/comments/909308315/reactions
2021-08-31T14:48:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/909308315
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
The CI failure is unrelated to this PR - let me take a look
2021-08-31T15:29:59Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-909344287
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42M34f
https://api.github.com/repos/huggingface/datasets/issues/comments/909344287/reactions
2021-08-31T15:29:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/909344287
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
> Thanks for adding this one! I just did some minor changes and set the timeout back to 100sec instead of 1000

Thank you for updating the language tags. I tried timeout values up to 300 sec on my local machine, but some of the larger files still get timed out. Although this could have been a network issue on my end, have you verified that 100 sec works for all files?
2021-08-31T16:49:45Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-909408948
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42NHq0
https://api.github.com/repos/huggingface/datasets/issues/comments/909408948/reactions
2021-08-31T16:49:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/909408948
https://avatars.githubusercontent.com/u/49608995?v=4
https://api.github.com/users/abhik1505040/events{/privacy}
https://api.github.com/users/abhik1505040/followers
https://api.github.com/users/abhik1505040/following{/other_user}
https://api.github.com/users/abhik1505040/gists{/gist_id}
https://github.com/abhik1505040
abhik1505040
MDQ6VXNlcjQ5NjA4OTk1
https://api.github.com/users/abhik1505040/orgs
https://api.github.com/users/abhik1505040/received_events
https://api.github.com/users/abhik1505040/repos
https://api.github.com/users/abhik1505040/starred{/owner}{/repo}
https://api.github.com/users/abhik1505040/subscriptions
User
https://api.github.com/users/abhik1505040
public
MEMBER
Well the main issue with google drive - even before the time out issues - is that it has a daily quota of downloads per file.
Therefore if many people start downloading this dataset, it will be unavailable until the quota is reset the next day.

So ideally it would be nice if the data were hosted elsewhere than Google drive, to avoid the quota and time out issue.
HF can probably help with hosting the data if needed
2021-08-31T17:01:49Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-909418303
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42NJ8_
https://api.github.com/repos/huggingface/datasets/issues/comments/909418303/reactions
2021-08-31T17:02:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/909418303
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
> Well the main issue with google drive - even before the time out issues - is that it has a daily quota of downloads per file.
> Therefore if many people start downloading this dataset, it will be unavailable until the quota is reset the next day.
> 
> So ideally it would be nice if the data were hosted elsewhere than Google drive, to avoid the quota and time out issue.
> HF can probably help with hosting the data if needed

It'd be great if the dataset can be hosted in HF. How should I proceed here though? Upload the dataset files as a community dataset and update the links in this pull request or is there a more straightforward way?
2021-09-03T08:09:15Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-912347192
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42YVA4
https://api.github.com/repos/huggingface/datasets/issues/comments/912347192/reactions
2021-09-03T08:09:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/912347192
https://avatars.githubusercontent.com/u/49608995?v=4
https://api.github.com/users/abhik1505040/events{/privacy}
https://api.github.com/users/abhik1505040/followers
https://api.github.com/users/abhik1505040/following{/other_user}
https://api.github.com/users/abhik1505040/gists{/gist_id}
https://github.com/abhik1505040
abhik1505040
MDQ6VXNlcjQ5NjA4OTk1
https://api.github.com/users/abhik1505040/orgs
https://api.github.com/users/abhik1505040/received_events
https://api.github.com/users/abhik1505040/repos
https://api.github.com/users/abhik1505040/starred{/owner}{/repo}
https://api.github.com/users/abhik1505040/subscriptions
User
https://api.github.com/users/abhik1505040
public
MEMBER
Hi ! Ideally everything should be in the same place, so feel free to create a community dataset on the Hub and upload your data files as well as you dataset script (and also the readme.md and dataset_infos.json).

The only change you have to do in your dataset script is use a relative path to your data files instead of urls.
For example if your repository looks like this:
```
xlsum/
├── data/
│   ├── amharic_XLSum_v2.0.tar.bz2
│   ├── ...
│   └── yoruba_XLSum_v2.0.tar.bz2
├── xlsum.py
├── README.md
└── dataset_infos.json
```
Then you just need to pass `"data/amharic_XLSum_v2.0.tar.bz2"` to `dl_manager.download_and_extract(...)`, instead of an url.

Locally you can test that it's working as expected with
```python
load_dataset("path/to/my/directory/named/xlsum")
```

Then once it's on the Hub, you can load it with
```python
load_dataset("username/xlsum")
```

Let me know if you have questions :)
2021-09-06T15:58:34Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-913743578
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42dp7a
https://api.github.com/repos/huggingface/datasets/issues/comments/913743578/reactions
2021-09-06T15:58:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/913743578
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Thank you for your detailed response regarding the community dataset building process. However, will this pull request be merged into the main branch?
2021-09-14T09:24:17Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-918976032
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42xnYg
https://api.github.com/repos/huggingface/datasets/issues/comments/918976032/reactions
2021-09-14T09:24:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/918976032
https://avatars.githubusercontent.com/u/49608995?v=4
https://api.github.com/users/abhik1505040/events{/privacy}
https://api.github.com/users/abhik1505040/followers
https://api.github.com/users/abhik1505040/following{/other_user}
https://api.github.com/users/abhik1505040/gists{/gist_id}
https://github.com/abhik1505040
abhik1505040
MDQ6VXNlcjQ5NjA4OTk1
https://api.github.com/users/abhik1505040/orgs
https://api.github.com/users/abhik1505040/received_events
https://api.github.com/users/abhik1505040/repos
https://api.github.com/users/abhik1505040/starred{/owner}{/repo}
https://api.github.com/users/abhik1505040/subscriptions
User
https://api.github.com/users/abhik1505040
public
MEMBER
If XL-sum is available via the Hub we don't need to add it again in the `datasets` github repo ;)
2021-09-14T09:54:07Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-918998003
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps42xsvz
https://api.github.com/repos/huggingface/datasets/issues/comments/918998003/reactions
2021-09-14T09:54:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/918998003
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
The dataset has now been uploaded on HF hub. It's available at https://huggingface.co/datasets/csebuetnlp/xlsum. Closing this pull request. Thank you for your contributions. 
2021-09-23T17:49:05Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-926027205
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps43Mg3F
https://api.github.com/repos/huggingface/datasets/issues/comments/926027205/reactions
2021-09-23T17:49:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/926027205
https://avatars.githubusercontent.com/u/49608995?v=4
https://api.github.com/users/abhik1505040/events{/privacy}
https://api.github.com/users/abhik1505040/followers
https://api.github.com/users/abhik1505040/following{/other_user}
https://api.github.com/users/abhik1505040/gists{/gist_id}
https://github.com/abhik1505040
abhik1505040
MDQ6VXNlcjQ5NjA4OTk1
https://api.github.com/users/abhik1505040/orgs
https://api.github.com/users/abhik1505040/received_events
https://api.github.com/users/abhik1505040/repos
https://api.github.com/users/abhik1505040/starred{/owner}{/repo}
https://api.github.com/users/abhik1505040/subscriptions
User
https://api.github.com/users/abhik1505040
public
MEMBER
Thank you !
2021-09-29T08:13:44Z
https://github.com/huggingface/datasets/pull/2819#issuecomment-929944819
https://api.github.com/repos/huggingface/datasets/issues/2819
IC_kwDODunzps43bdTz
https://api.github.com/repos/huggingface/datasets/issues/comments/929944819/reactions
2021-09-29T08:13:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/929944819
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Added XL-Sum dataset published in ACL-IJCNLP 2021. (https://aclanthology.org/2021.findings-acl.413/). The default timeout values in `src/datasets/utils/file_utls.py` were increased to enable downloading from the original google drive links.