Add OSCAR dataset
CONTRIBUTOR
@pjox I think the tests don't pass because you haven't provided any dummy data (`dummy_data.zip`).

 
2020-07-07T11:16:47Z
https://github.com/huggingface/datasets/pull/348#issuecomment-654783503
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDY1NDc4MzUwMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/654783503/reactions
2020-07-07T11:16:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/654783503
https://avatars.githubusercontent.com/u/13795113?v=4
https://api.github.com/users/ghomasHudson/events{/privacy}
https://api.github.com/users/ghomasHudson/followers
https://api.github.com/users/ghomasHudson/following{/other_user}
https://api.github.com/users/ghomasHudson/gists{/gist_id}
https://github.com/ghomasHudson
ghomasHudson
MDQ6VXNlcjEzNzk1MTEz
https://api.github.com/users/ghomasHudson/orgs
https://api.github.com/users/ghomasHudson/received_events
https://api.github.com/users/ghomasHudson/repos
https://api.github.com/users/ghomasHudson/starred{/owner}{/repo}
https://api.github.com/users/ghomasHudson/subscriptions
User
https://api.github.com/users/ghomasHudson
public
CONTRIBUTOR
> @pjox I think the tests don't pass because you haven't provided any dummy data (`dummy_data.zip`).

But can I do the dummy data without running `python nlp-cli test datasets/<your-dataset-folder> --save_infos --all_configs` first? 🤔 
2020-07-07T12:01:02Z
https://github.com/huggingface/datasets/pull/348#issuecomment-654807312
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDY1NDgwNzMxMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/654807312/reactions
2020-07-07T12:01:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/654807312
https://avatars.githubusercontent.com/u/635220?v=4
https://api.github.com/users/pjox/events{/privacy}
https://api.github.com/users/pjox/followers
https://api.github.com/users/pjox/following{/other_user}
https://api.github.com/users/pjox/gists{/gist_id}
https://github.com/pjox
pjox
MDQ6VXNlcjYzNTIyMA==
https://api.github.com/users/pjox/orgs
https://api.github.com/users/pjox/received_events
https://api.github.com/users/pjox/repos
https://api.github.com/users/pjox/starred{/owner}{/repo}
https://api.github.com/users/pjox/subscriptions
User
https://api.github.com/users/pjox
public
CONTRIBUTOR
You make a good point! Do you know how big is it uncompressed?
2020-07-07T12:05:13Z
https://github.com/huggingface/datasets/pull/348#issuecomment-654809105
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDY1NDgwOTEwNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/654809105/reactions
2020-07-07T12:05:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/654809105
https://avatars.githubusercontent.com/u/13795113?v=4
https://api.github.com/users/ghomasHudson/events{/privacy}
https://api.github.com/users/ghomasHudson/followers
https://api.github.com/users/ghomasHudson/following{/other_user}
https://api.github.com/users/ghomasHudson/gists{/gist_id}
https://github.com/ghomasHudson
ghomasHudson
MDQ6VXNlcjEzNzk1MTEz
https://api.github.com/users/ghomasHudson/orgs
https://api.github.com/users/ghomasHudson/received_events
https://api.github.com/users/ghomasHudson/repos
https://api.github.com/users/ghomasHudson/starred{/owner}{/repo}
https://api.github.com/users/ghomasHudson/subscriptions
User
https://api.github.com/users/ghomasHudson
public
CONTRIBUTOR
Between 7T and 9T I think.
2020-07-07T13:57:16Z
https://github.com/huggingface/datasets/pull/348#issuecomment-654881122
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDY1NDg4MTEyMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/654881122/reactions
2020-07-07T13:57:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/654881122
https://avatars.githubusercontent.com/u/635220?v=4
https://api.github.com/users/pjox/events{/privacy}
https://api.github.com/users/pjox/followers
https://api.github.com/users/pjox/following{/other_user}
https://api.github.com/users/pjox/gists{/gist_id}
https://github.com/pjox
pjox
MDQ6VXNlcjYzNTIyMA==
https://api.github.com/users/pjox/orgs
https://api.github.com/users/pjox/received_events
https://api.github.com/users/pjox/repos
https://api.github.com/users/pjox/starred{/owner}{/repo}
https://api.github.com/users/pjox/subscriptions
User
https://api.github.com/users/pjox
public
MEMBER
Hi ! I've been busy but I plan to compute the missing metadata soon !
Looking forward to be able to load a memory mapped version of OSCAR :) 
2020-10-27T17:40:41Z
https://github.com/huggingface/datasets/pull/348#issuecomment-717410364
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDcxNzQxMDM2NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/717410364/reactions
2020-10-27T17:40:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/717410364
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
> Hi ! I've been busy but I plan to compute the missing metadata soon !
> Looking forward to be able to load a memory mapped version of OSCAR :)

Amazing! Thanks! 😄 
2020-10-28T14:14:30Z
https://github.com/huggingface/datasets/pull/348#issuecomment-717961790
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDcxNzk2MTc5MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/717961790/reactions
2020-10-28T14:14:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/717961790
https://avatars.githubusercontent.com/u/635220?v=4
https://api.github.com/users/pjox/events{/privacy}
https://api.github.com/users/pjox/followers
https://api.github.com/users/pjox/following{/other_user}
https://api.github.com/users/pjox/gists{/gist_id}
https://github.com/pjox
pjox
MDQ6VXNlcjYzNTIyMA==
https://api.github.com/users/pjox/orgs
https://api.github.com/users/pjox/received_events
https://api.github.com/users/pjox/repos
https://api.github.com/users/pjox/starred{/owner}{/repo}
https://api.github.com/users/pjox/subscriptions
User
https://api.github.com/users/pjox
public
CONTRIBUTOR
Hi there, are there any plans to complete this issue soon? I'm planning to use this dataset on a project. Let me know if there's anything I can do to help to finish this 🤗 
2020-12-29T02:07:44Z
https://github.com/huggingface/datasets/pull/348#issuecomment-751920456
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MTkyMDQ1Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/751920456/reactions
2020-12-29T02:07:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/751920456
https://avatars.githubusercontent.com/u/5097052?v=4
https://api.github.com/users/jonatasgrosman/events{/privacy}
https://api.github.com/users/jonatasgrosman/followers
https://api.github.com/users/jonatasgrosman/following{/other_user}
https://api.github.com/users/jonatasgrosman/gists{/gist_id}
https://github.com/jonatasgrosman
jonatasgrosman
MDQ6VXNlcjUwOTcwNTI=
https://api.github.com/users/jonatasgrosman/orgs
https://api.github.com/users/jonatasgrosman/received_events
https://api.github.com/users/jonatasgrosman/repos
https://api.github.com/users/jonatasgrosman/starred{/owner}{/repo}
https://api.github.com/users/jonatasgrosman/subscriptions
User
https://api.github.com/users/jonatasgrosman
public
MEMBER
Yes it will be added soon :) 
Recently the OSCAR data files were moved to another host. We just need to update the script and compute the dataset_infos.json (it will probably take a few days).
2020-12-29T09:32:14Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752011368
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjAxMTM2OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/752011368/reactions
2020-12-29T09:32:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752011368
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq I've seen in oscar.py that it isn't a dataset script with manual download way. Is that correct? 
Some time ago, @pjox had some troubles with his servers providing that dataset 'cause it's really huge. Providing it on an automatic download way seems to be a little bit dangerous for me 😄 
2020-12-30T17:25:36Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752697858
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjY5Nzg1OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/752697858/reactions
2020-12-30T17:25:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752697858
https://avatars.githubusercontent.com/u/5097052?v=4
https://api.github.com/users/jonatasgrosman/events{/privacy}
https://api.github.com/users/jonatasgrosman/followers
https://api.github.com/users/jonatasgrosman/following{/other_user}
https://api.github.com/users/jonatasgrosman/gists{/gist_id}
https://github.com/jonatasgrosman
jonatasgrosman
MDQ6VXNlcjUwOTcwNTI=
https://api.github.com/users/jonatasgrosman/orgs
https://api.github.com/users/jonatasgrosman/received_events
https://api.github.com/users/jonatasgrosman/repos
https://api.github.com/users/jonatasgrosman/starred{/owner}{/repo}
https://api.github.com/users/jonatasgrosman/subscriptions
User
https://api.github.com/users/jonatasgrosman
public
MEMBER
Now thanks to @pjox 's help OSCAR is hosted on HF's S3, which is probably more robust that the previous servers :)

Also small update on my side:
I launched the computation of the dataset_infos.json file, it will take a few days.
2020-12-30T17:30:07Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752699152
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjY5OTE1Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/752699152/reactions
2020-12-30T17:30:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752699152
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Now it seems to be a good plan for me 🤗 
2020-12-30T17:34:53Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752700577
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjcwMDU3Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/752700577/reactions
2020-12-30T17:34:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752700577
https://avatars.githubusercontent.com/u/5097052?v=4
https://api.github.com/users/jonatasgrosman/events{/privacy}
https://api.github.com/users/jonatasgrosman/followers
https://api.github.com/users/jonatasgrosman/following{/other_user}
https://api.github.com/users/jonatasgrosman/gists{/gist_id}
https://github.com/jonatasgrosman
jonatasgrosman
MDQ6VXNlcjUwOTcwNTI=
https://api.github.com/users/jonatasgrosman/orgs
https://api.github.com/users/jonatasgrosman/received_events
https://api.github.com/users/jonatasgrosman/repos
https://api.github.com/users/jonatasgrosman/starred{/owner}{/repo}
https://api.github.com/users/jonatasgrosman/subscriptions
User
https://api.github.com/users/jonatasgrosman
public
CONTRIBUTOR
But is there a plan to provide the OSCAR's unshuffled version too?
2020-12-30T17:36:12Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752700954
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjcwMDk1NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/752700954/reactions
2020-12-30T17:36:12Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752700954
https://avatars.githubusercontent.com/u/5097052?v=4
https://api.github.com/users/jonatasgrosman/events{/privacy}
https://api.github.com/users/jonatasgrosman/followers
https://api.github.com/users/jonatasgrosman/following{/other_user}
https://api.github.com/users/jonatasgrosman/gists{/gist_id}
https://github.com/jonatasgrosman
jonatasgrosman
MDQ6VXNlcjUwOTcwNTI=
https://api.github.com/users/jonatasgrosman/orgs
https://api.github.com/users/jonatasgrosman/received_events
https://api.github.com/users/jonatasgrosman/repos
https://api.github.com/users/jonatasgrosman/starred{/owner}{/repo}
https://api.github.com/users/jonatasgrosman/subscriptions
User
https://api.github.com/users/jonatasgrosman
public
MEMBER
The one we have on S3 is currently the unshuffled version
2020-12-30T17:36:58Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752701180
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjcwMTE4MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/752701180/reactions
2020-12-30T17:36:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752701180
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
I've thought that you won't provide the unshuffled version 'cause this comment on oscar.py:

`# TODO(oscar): Implement unshuffled OSCAR`


2020-12-30T17:39:52Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752702009
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjcwMjAwOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/752702009/reactions
2020-12-30T17:39:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752702009
https://avatars.githubusercontent.com/u/5097052?v=4
https://api.github.com/users/jonatasgrosman/events{/privacy}
https://api.github.com/users/jonatasgrosman/followers
https://api.github.com/users/jonatasgrosman/following{/other_user}
https://api.github.com/users/jonatasgrosman/gists{/gist_id}
https://github.com/jonatasgrosman
jonatasgrosman
MDQ6VXNlcjUwOTcwNTI=
https://api.github.com/users/jonatasgrosman/orgs
https://api.github.com/users/jonatasgrosman/received_events
https://api.github.com/users/jonatasgrosman/repos
https://api.github.com/users/jonatasgrosman/starred{/owner}{/repo}
https://api.github.com/users/jonatasgrosman/subscriptions
User
https://api.github.com/users/jonatasgrosman
public
CONTRIBUTOR
That TODO is normal, I haven't touched the python script in months (I haven't had the time, sorry), but I guess @lhoestq fixed the paths if he's already working on the metadata. In any case from now on, only the unshuffled versions of OSCAR will be distributed through the hf/datasets library as in any case it is the version most people use to train language models.

If for any reason, you need the shuffled version it will always be available on the [OSCAR website](https://oscar-corpus.com).

Also future versions of OSCAR will be unshuffled only.
2020-12-30T17:48:53Z
https://github.com/huggingface/datasets/pull/348#issuecomment-752704437
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc1MjcwNDQzNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/752704437/reactions
2020-12-30T17:48:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/752704437
https://avatars.githubusercontent.com/u/635220?v=4
https://api.github.com/users/pjox/events{/privacy}
https://api.github.com/users/pjox/followers
https://api.github.com/users/pjox/following{/other_user}
https://api.github.com/users/pjox/gists{/gist_id}
https://github.com/pjox
pjox
MDQ6VXNlcjYzNTIyMA==
https://api.github.com/users/pjox/orgs
https://api.github.com/users/pjox/received_events
https://api.github.com/users/pjox/repos
https://api.github.com/users/pjox/starred{/owner}{/repo}
https://api.github.com/users/pjox/subscriptions
User
https://api.github.com/users/pjox
public
CONTRIBUTOR
Should we close this PR now that the other one was merged?
2021-02-08T23:15:25Z
https://github.com/huggingface/datasets/pull/348#issuecomment-775527279
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc3NTUyNzI3OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/775527279/reactions
2021-02-08T23:15:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/775527279
https://avatars.githubusercontent.com/u/635220?v=4
https://api.github.com/users/pjox/events{/privacy}
https://api.github.com/users/pjox/followers
https://api.github.com/users/pjox/following{/other_user}
https://api.github.com/users/pjox/gists{/gist_id}
https://github.com/pjox
pjox
MDQ6VXNlcjYzNTIyMA==
https://api.github.com/users/pjox/orgs
https://api.github.com/users/pjox/received_events
https://api.github.com/users/pjox/repos
https://api.github.com/users/pjox/starred{/owner}{/repo}
https://api.github.com/users/pjox/subscriptions
User
https://api.github.com/users/pjox
public
MEMBER
Sure.
Closing since #1694 is merged
2021-02-09T10:19:19Z
https://github.com/huggingface/datasets/pull/348#issuecomment-775829422
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDc3NTgyOTQyMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/775829422/reactions
2021-02-09T10:19:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/775829422
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
@lhoestq just a little detail, is the Oscar version that HF offers the same one that was available on INRIA? By that I mean, have you done any further filtering or removing of data inside it? Thanks a lot! 
2021-05-03T18:49:45Z
https://github.com/huggingface/datasets/pull/348#issuecomment-831459380
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDgzMTQ1OTM4MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/831459380/reactions
2021-05-03T18:49:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/831459380
https://avatars.githubusercontent.com/u/34098722?v=4
https://api.github.com/users/jchwenger/events{/privacy}
https://api.github.com/users/jchwenger/followers
https://api.github.com/users/jchwenger/following{/other_user}
https://api.github.com/users/jchwenger/gists{/gist_id}
https://github.com/jchwenger
jchwenger
MDQ6VXNlcjM0MDk4NzIy
https://api.github.com/users/jchwenger/orgs
https://api.github.com/users/jchwenger/received_events
https://api.github.com/users/jchwenger/repos
https://api.github.com/users/jchwenger/starred{/owner}{/repo}
https://api.github.com/users/jchwenger/subscriptions
User
https://api.github.com/users/jchwenger
public
CONTRIBUTOR
Hello @jchwenger, this is exactly the same (unshuffled) version that's available at Inria. Sadly no further filtering is provided, but after the latest OSCAR audit (https://arxiv.org/abs/2103.12028) we're already working on future versions of OSCAR that will be "filtered" and that will be available on the OSCAR website and hopefully here as well.
2021-05-03T21:00:25Z
https://github.com/huggingface/datasets/pull/348#issuecomment-831530780
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDgzMTUzMDc4MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/831530780/reactions
2021-05-03T21:00:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/831530780
https://avatars.githubusercontent.com/u/635220?v=4
https://api.github.com/users/pjox/events{/privacy}
https://api.github.com/users/pjox/followers
https://api.github.com/users/pjox/following{/other_user}
https://api.github.com/users/pjox/gists{/gist_id}
https://github.com/pjox
pjox
MDQ6VXNlcjYzNTIyMA==
https://api.github.com/users/pjox/orgs
https://api.github.com/users/pjox/received_events
https://api.github.com/users/pjox/repos
https://api.github.com/users/pjox/starred{/owner}{/repo}
https://api.github.com/users/pjox/subscriptions
User
https://api.github.com/users/pjox
public
NONE
@pjox brilliant, in my case I was hoping it would be unfiltered, good news!
2021-05-03T22:07:08Z
https://github.com/huggingface/datasets/pull/348#issuecomment-831565383
https://api.github.com/repos/huggingface/datasets/issues/348
MDEyOklzc3VlQ29tbWVudDgzMTU2NTM4Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/831565383/reactions
2021-05-03T22:07:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/831565383
https://avatars.githubusercontent.com/u/34098722?v=4
https://api.github.com/users/jchwenger/events{/privacy}
https://api.github.com/users/jchwenger/followers
https://api.github.com/users/jchwenger/following{/other_user}
https://api.github.com/users/jchwenger/gists{/gist_id}
https://github.com/jchwenger
jchwenger
MDQ6VXNlcjM0MDk4NzIy
https://api.github.com/users/jchwenger/orgs
https://api.github.com/users/jchwenger/received_events
https://api.github.com/users/jchwenger/repos
https://api.github.com/users/jchwenger/starred{/owner}{/repo}
https://api.github.com/users/jchwenger/subscriptions
User
https://api.github.com/users/jchwenger
public
I don't know if tests pass, when I run them it tries to download the whole corpus which is around 3.5TB compressed and I don't have that kind of space. I'll really need some help with it 😅 

Thanks!