[Scientific papers] Mirror datasets zip
CONTRIBUTOR
> Nice !
> 
> Could you try to reduce the size of the dummy_data.zip files ? they're quite big (300KB)

Yes, I think it might make sense to enhance the tool a tiny bit to prevent this automatically
2021-01-12T10:36:11Z
https://github.com/huggingface/datasets/pull/1721#issuecomment-758565760
https://api.github.com/repos/huggingface/datasets/issues/1721
MDEyOklzc3VlQ29tbWVudDc1ODU2NTc2MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/758565760/reactions
2021-01-12T10:36:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/758565760
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
That's the lightest I can make it...it's long-range summarization so a single sample has ~11000 tokens. 
2021-01-12T10:43:47Z
https://github.com/huggingface/datasets/pull/1721#issuecomment-758570036
https://api.github.com/repos/huggingface/datasets/issues/1721
MDEyOklzc3VlQ29tbWVudDc1ODU3MDAzNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/758570036/reactions
2021-01-12T10:43:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/758570036
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
MEMBER
Ok thanks :)
2021-01-12T10:44:35Z
https://github.com/huggingface/datasets/pull/1721#issuecomment-758570500
https://api.github.com/repos/huggingface/datasets/issues/1721
MDEyOklzc3VlQ29tbWVudDc1ODU3MDUwMA==
https://api.github.com/repos/huggingface/datasets/issues/comments/758570500/reactions
2021-01-12T10:44:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/758570500
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Awesome good to merge for me :-) 
2021-01-12T11:40:42Z
https://github.com/huggingface/datasets/pull/1721#issuecomment-758600460
https://api.github.com/repos/huggingface/datasets/issues/1721
MDEyOklzc3VlQ29tbWVudDc1ODYwMDQ2MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/758600460/reactions
2021-01-12T11:40:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/758600460
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
Datasets were uploading to https://s3.amazonaws.com/datasets.huggingface.co/scientific_papers/1.1.1/arxiv-dataset.zip and https://s3.amazonaws.com/datasets.huggingface.co/scientific_papers/1.1.1/pubmed-dataset.zip respectively to escape google drive quota and enable faster download. 