add pg19 dataset
CONTRIBUTOR
@lucidrains - Thanks a lot for making the PR - PG19 is a super important dataset! Thanks for making it. Many people are asking for PG-19, so it would be great to have that in the library as soon as possible @thomwolf .
2020-06-25T09:27:09Z
https://github.com/huggingface/datasets/pull/306#issuecomment-649420003
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY0OTQyMDAwMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/649420003/reactions
2020-06-25T09:27:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/649420003
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
@mariamabarham yup! around 11GB!
2020-06-25T15:21:27Z
https://github.com/huggingface/datasets/pull/306#issuecomment-649618253
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY0OTYxODI1Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/649618253/reactions
2020-06-25T15:21:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/649618253
https://avatars.githubusercontent.com/u/108653?v=4
https://api.github.com/users/lucidrains/events{/privacy}
https://api.github.com/users/lucidrains/followers
https://api.github.com/users/lucidrains/following{/other_user}
https://api.github.com/users/lucidrains/gists{/gist_id}
https://github.com/lucidrains
lucidrains
MDQ6VXNlcjEwODY1Mw==
https://api.github.com/users/lucidrains/orgs
https://api.github.com/users/lucidrains/received_events
https://api.github.com/users/lucidrains/repos
https://api.github.com/users/lucidrains/starred{/owner}{/repo}
https://api.github.com/users/lucidrains/subscriptions
User
https://api.github.com/users/lucidrains
public
CONTRIBUTOR
I'm looking forward to our first deep learning written novel already lol. It's definitely happening
2020-06-25T18:55:59Z
https://github.com/huggingface/datasets/pull/306#issuecomment-649758869
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY0OTc1ODg2OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/649758869/reactions
2020-06-25T18:55:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/649758869
https://avatars.githubusercontent.com/u/108653?v=4
https://api.github.com/users/lucidrains/events{/privacy}
https://api.github.com/users/lucidrains/followers
https://api.github.com/users/lucidrains/following{/other_user}
https://api.github.com/users/lucidrains/gists{/gist_id}
https://github.com/lucidrains
lucidrains
MDQ6VXNlcjEwODY1Mw==
https://api.github.com/users/lucidrains/orgs
https://api.github.com/users/lucidrains/received_events
https://api.github.com/users/lucidrains/repos
https://api.github.com/users/lucidrains/starred{/owner}{/repo}
https://api.github.com/users/lucidrains/subscriptions
User
https://api.github.com/users/lucidrains
public
CONTRIBUTOR
Good to merge IMO.
2020-06-29T07:58:20Z
https://github.com/huggingface/datasets/pull/306#issuecomment-650997569
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1MDk5NzU2OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/650997569/reactions
2020-06-29T07:58:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/650997569
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
MEMBER
Oh I just noticed but as we changed the urls to download the files, we have to update `dataset_infos.json`.
Could you re-rurn `nlp-cli test ./datasets/pg19 --save_infos` ?
2020-06-30T08:23:02Z
https://github.com/huggingface/datasets/pull/306#issuecomment-651637931
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1MTYzNzkzMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/651637931/reactions
2020-06-30T08:23:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/651637931
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq on it!
2020-06-30T15:55:00Z
https://github.com/huggingface/datasets/pull/306#issuecomment-651885166
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1MTg4NTE2Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/651885166/reactions
2020-06-30T15:55:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/651885166
https://avatars.githubusercontent.com/u/108653?v=4
https://api.github.com/users/lucidrains/events{/privacy}
https://api.github.com/users/lucidrains/followers
https://api.github.com/users/lucidrains/following{/other_user}
https://api.github.com/users/lucidrains/gists{/gist_id}
https://github.com/lucidrains
lucidrains
MDQ6VXNlcjEwODY1Mw==
https://api.github.com/users/lucidrains/orgs
https://api.github.com/users/lucidrains/received_events
https://api.github.com/users/lucidrains/repos
https://api.github.com/users/lucidrains/starred{/owner}{/repo}
https://api.github.com/users/lucidrains/subscriptions
User
https://api.github.com/users/lucidrains
public
CONTRIBUTOR
should be good!
2020-07-02T19:36:29Z
https://github.com/huggingface/datasets/pull/306#issuecomment-653186807
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1MzE4NjgwNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/653186807/reactions
2020-07-02T19:36:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/653186807
https://avatars.githubusercontent.com/u/108653?v=4
https://api.github.com/users/lucidrains/events{/privacy}
https://api.github.com/users/lucidrains/followers
https://api.github.com/users/lucidrains/following{/other_user}
https://api.github.com/users/lucidrains/gists{/gist_id}
https://github.com/lucidrains
lucidrains
MDQ6VXNlcjEwODY1Mw==
https://api.github.com/users/lucidrains/orgs
https://api.github.com/users/lucidrains/received_events
https://api.github.com/users/lucidrains/repos
https://api.github.com/users/lucidrains/starred{/owner}{/repo}
https://api.github.com/users/lucidrains/subscriptions
User
https://api.github.com/users/lucidrains
public
CONTRIBUTOR
@lhoestq - I think it's good to merge no?
2020-07-05T11:00:55Z
https://github.com/huggingface/datasets/pull/306#issuecomment-653873890
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1Mzg3Mzg5MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/653873890/reactions
2020-07-05T11:00:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/653873890
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
MEMBER
`dataset_infos.json` is still not up to date with the new urls (we can see that there are urls like `gs://deepmind-gutenberg/train/*` instead of `https://storage.googleapis.com/deepmind-gutenberg/train/*` in the json file)

Can you check that you re-ran the command to update the json file, and that you pushed the changes @lucidrains ?
2020-07-05T12:23:52Z
https://github.com/huggingface/datasets/pull/306#issuecomment-653882340
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1Mzg4MjM0MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/653882340/reactions
2020-07-05T12:23:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/653882340
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq ohhh, I made the change in this commit https://github.com/lucidrains/nlp/commit/f3e23d823ad9942031be80b7c4e4212c592cd90c , that's interesting that the pull request didn't pick it up. maybe it's because I did it on another machine, let me check and get back to you!
2020-07-05T16:46:27Z
https://github.com/huggingface/datasets/pull/306#issuecomment-653911018
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1MzkxMTAxOA==
https://api.github.com/repos/huggingface/datasets/issues/comments/653911018/reactions
2020-07-05T16:46:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/653911018
https://avatars.githubusercontent.com/u/108653?v=4
https://api.github.com/users/lucidrains/events{/privacy}
https://api.github.com/users/lucidrains/followers
https://api.github.com/users/lucidrains/following{/other_user}
https://api.github.com/users/lucidrains/gists{/gist_id}
https://github.com/lucidrains
lucidrains
MDQ6VXNlcjEwODY1Mw==
https://api.github.com/users/lucidrains/orgs
https://api.github.com/users/lucidrains/received_events
https://api.github.com/users/lucidrains/repos
https://api.github.com/users/lucidrains/starred{/owner}{/repo}
https://api.github.com/users/lucidrains/subscriptions
User
https://api.github.com/users/lucidrains
public
CONTRIBUTOR
@lhoestq wrong branch 😅 thanks for catching! 
2020-07-05T16:51:24Z
https://github.com/huggingface/datasets/pull/306#issuecomment-653911534
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1MzkxMTUzNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/653911534/reactions
2020-07-05T16:51:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/653911534
https://avatars.githubusercontent.com/u/108653?v=4
https://api.github.com/users/lucidrains/events{/privacy}
https://api.github.com/users/lucidrains/followers
https://api.github.com/users/lucidrains/following{/other_user}
https://api.github.com/users/lucidrains/gists{/gist_id}
https://github.com/lucidrains
lucidrains
MDQ6VXNlcjEwODY1Mw==
https://api.github.com/users/lucidrains/orgs
https://api.github.com/users/lucidrains/received_events
https://api.github.com/users/lucidrains/repos
https://api.github.com/users/lucidrains/starred{/owner}{/repo}
https://api.github.com/users/lucidrains/subscriptions
User
https://api.github.com/users/lucidrains
public
MEMBER
Awesome thanks 🎉
2020-07-06T07:55:53Z
https://github.com/huggingface/datasets/pull/306#issuecomment-654078047
https://api.github.com/repos/huggingface/datasets/issues/306
MDEyOklzc3VlQ29tbWVudDY1NDA3ODA0Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/654078047/reactions
2020-07-06T07:55:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/654078047
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
https://github.com/huggingface/nlp/issues/274

Add functioning PG19 dataset with dummy data

`cos_e.py` was just auto-linted by `make style`