Added Wiki Summary Dataset
CONTRIBUTOR
@lhoestq why my tests are not running?
2020-12-18T13:40:10Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748089580
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODA4OTU4MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/748089580/reactions
2020-12-18T13:40:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748089580
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
Maybe an issue with CircleCI, let me try to make them run
2020-12-18T13:42:14Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748090487
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODA5MDQ4Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/748090487/reactions
2020-12-18T13:42:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748090487
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
The CI error `tests/test_file_utils.py::TempSeedTest::test_tensorflow` is not related to this dataset and is fixed on master, you can ignore it
2020-12-18T13:49:19Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748093841
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODA5Mzg0MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748093841/reactions
2020-12-18T13:49:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748093841
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
what I need to do now
2020-12-18T13:54:31Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748096317
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODA5NjMxNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/748096317/reactions
2020-12-18T13:54:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748096317
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
Now the delimiter of the csv reader is fixed, thanks :) 

I just added a comment suggesting to try using actual URLS instead of a manual download if possible.
This would make things more convenient for the users. Can you try using the `dl_manager` to download the train/dev/test csv files instead of requiring manual download ?
2020-12-18T13:56:38Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748097303
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODA5NzMwMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/748097303/reactions
2020-12-18T13:56:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748097303
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Also pinging @m3hrdadfi , since I just noticed that there's already a dataset script that was created 3 weeks ago for this dataset here: https://github.com/m3hrdadfi/wiki-summary/tree/master/datasets/wiki_summary_persian
2020-12-18T14:02:15Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748099971
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODA5OTk3MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748099971/reactions
2020-12-18T14:02:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748099971
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq I am getting this error while generating the dummy data
![Screenshot (181)](https://user-images.githubusercontent.com/33005287/102628819-50a40080-4170-11eb-9e96-efce74b45ff4.png)

2020-12-18T15:03:46Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748133885
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODEzMzg4NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748133885/reactions
2020-12-18T15:03:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748133885
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
Can you try by adding the flag `--match_text_files "*"` ?
2020-12-18T15:05:16Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748135478
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODEzNTQ3OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/748135478/reactions
2020-12-18T15:05:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748135478
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
now it worked
2020-12-18T15:07:47Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748138688
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODEzODY4OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/748138688/reactions
2020-12-18T15:07:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748138688
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
CONTRIBUTOR
@lhoestq pytest on dummy data passed, but on real data raising this issue
![Screenshot (196)](https://user-images.githubusercontent.com/33005287/102630784-fa848c80-4172-11eb-9f7e-e5a58dcf7abe.png)
how to resolve it

2020-12-18T15:22:55Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748153081
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE1MzA4MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748153081/reactions
2020-12-18T15:22:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748153081
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
I see ! This is because the library did some verification to make sure it downloads the same files as in the first time you ran the `datasets-cli test` command with `--save_infos`. Since we're now downloading files, the verification fails. 

To fix that you just need to regenerate the dataset_infos.json file:
```
datasets-cli test ./datasets/wiki_summary --save_infos --all_configs --ignore_verifications
```
2020-12-18T15:27:14Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748156001
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE1NjAwMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748156001/reactions
2020-12-18T15:27:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748156001
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq I have modified everything and It worked fine, dont know why it is not passing the tests 
2020-12-18T15:52:24Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748169655
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE2OTY1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748169655/reactions
2020-12-18T15:52:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748169655
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
Awesome thank you !

The CI error `tests/test_file_utils.py::TempSeedTest::test_tensorflow` is not related to your dataset and is fixed on master.
You can ignore it :) 
2020-12-18T15:58:10Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748172811
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE3MjgxMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/748172811/reactions
2020-12-18T15:58:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748172811
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq anything left to do ?
2020-12-18T15:58:54Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748173206
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE3MzIwNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/748173206/reactions
2020-12-18T15:58:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748173206
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
The dataset script is all good now ! The dummy data and the dataset_infos.json file are good too :) 
2020-12-18T15:59:47Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748173676
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE3MzY3Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/748173676/reactions
2020-12-18T15:59:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748173676
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq yay, thanks for helping me out , 
2020-12-18T16:11:39Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748179962
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE3OTk2Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/748179962/reactions
2020-12-18T16:11:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748179962
https://avatars.githubusercontent.com/u/33005287?v=4
https://api.github.com/users/tanmoyio/events{/privacy}
https://api.github.com/users/tanmoyio/followers
https://api.github.com/users/tanmoyio/following{/other_user}
https://api.github.com/users/tanmoyio/gists{/gist_id}
https://github.com/tanmoyio
tanmoyio
MDQ6VXNlcjMzMDA1Mjg3
https://api.github.com/users/tanmoyio/orgs
https://api.github.com/users/tanmoyio/received_events
https://api.github.com/users/tanmoyio/repos
https://api.github.com/users/tanmoyio/starred{/owner}{/repo}
https://api.github.com/users/tanmoyio/subscriptions
User
https://api.github.com/users/tanmoyio
public
MEMBER
merging since the CI is fixed on master
2020-12-18T16:17:13Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748183048
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE4MzA0OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/748183048/reactions
2020-12-18T16:17:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748183048
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@tanmoyio @lhoestq 

Thank you both!
2020-12-18T16:20:06Z
https://github.com/huggingface/datasets/pull/1544#issuecomment-748184654
https://api.github.com/repos/huggingface/datasets/issues/1544
MDEyOklzc3VlQ29tbWVudDc0ODE4NDY1NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/748184654/reactions
2020-12-18T16:20:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/748184654
https://avatars.githubusercontent.com/u/2601833?v=4
https://api.github.com/users/m3hrdadfi/events{/privacy}
https://api.github.com/users/m3hrdadfi/followers
https://api.github.com/users/m3hrdadfi/following{/other_user}
https://api.github.com/users/m3hrdadfi/gists{/gist_id}
https://github.com/m3hrdadfi
m3hrdadfi
MDQ6VXNlcjI2MDE4MzM=
https://api.github.com/users/m3hrdadfi/orgs
https://api.github.com/users/m3hrdadfi/received_events
https://api.github.com/users/m3hrdadfi/repos
https://api.github.com/users/m3hrdadfi/starred{/owner}{/repo}
https://api.github.com/users/m3hrdadfi/subscriptions
User
https://api.github.com/users/m3hrdadfi
public
Wiki Summary: Dataset extracted from Persian Wikipedia into the form of articles and highlights.
Link: https://github.com/m3hrdadfi/wiki-summary