[Feature request] Add Google Natural Question dataset
MEMBER
Indeed, I think this one is almost ready cc @lhoestq 
2020-05-17T13:02:22Z
https://github.com/huggingface/datasets/issues/129#issuecomment-629794261
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDYyOTc5NDI2MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/629794261/reactions
2020-05-17T13:02:22Z
https://api.github.com/repos/huggingface/datasets/issues/comments/629794261
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
I'm doing the latest adjustments to make the processing of the dataset run on Dataflow
2020-05-18T08:49:07Z
https://github.com/huggingface/datasets/issues/129#issuecomment-630039515
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDYzMDAzOTUxNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/630039515/reactions
2020-05-18T08:49:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/630039515
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Is there an update to this? It will be very beneficial for the QA community!
2020-05-22T12:57:45Z
https://github.com/huggingface/datasets/issues/129#issuecomment-632677329
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDYzMjY3NzMyOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/632677329/reactions
2020-05-22T12:57:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/632677329
https://avatars.githubusercontent.com/u/19197923?v=4
https://api.github.com/users/ronakice/events{/privacy}
https://api.github.com/users/ronakice/followers
https://api.github.com/users/ronakice/following{/other_user}
https://api.github.com/users/ronakice/gists{/gist_id}
https://github.com/ronakice
ronakice
MDQ6VXNlcjE5MTk3OTIz
https://api.github.com/users/ronakice/orgs
https://api.github.com/users/ronakice/received_events
https://api.github.com/users/ronakice/repos
https://api.github.com/users/ronakice/starred{/owner}{/repo}
https://api.github.com/users/ronakice/subscriptions
User
https://api.github.com/users/ronakice
public
MEMBER
Still work in progress :)
The idea is to have the dataset already processed somewhere so that the user only have to download the processed files. I'm also doing it for wikipedia.
2020-05-22T13:00:41Z
https://github.com/huggingface/datasets/issues/129#issuecomment-632678506
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDYzMjY3ODUwNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/632678506/reactions
2020-05-22T13:00:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/632678506
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Super appreciate your hard work !!
I'll cross my fingers and hope easily loadable wikipedia dataset will come soon. 
2020-05-23T10:18:31Z
https://github.com/huggingface/datasets/issues/129#issuecomment-633020870
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDYzMzAyMDg3MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/633020870/reactions
2020-05-23T10:18:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/633020870
https://avatars.githubusercontent.com/u/17963619?v=4
https://api.github.com/users/richarddwang/events{/privacy}
https://api.github.com/users/richarddwang/followers
https://api.github.com/users/richarddwang/following{/other_user}
https://api.github.com/users/richarddwang/gists{/gist_id}
https://github.com/richarddwang
richarddwang
MDQ6VXNlcjE3OTYzNjE5
https://api.github.com/users/richarddwang/orgs
https://api.github.com/users/richarddwang/received_events
https://api.github.com/users/richarddwang/repos
https://api.github.com/users/richarddwang/starred{/owner}{/repo}
https://api.github.com/users/richarddwang/subscriptions
User
https://api.github.com/users/richarddwang
public
MEMBER
Quick update on NQ: due to some limitations I met using apache beam + parquet I was not able to use the dataset in a nested parquet structure in python to convert it to our Apache Arrow format yet.
However we had planned to change this conversion step anyways so we'll make just sure that it enables to process and convert the NQ dataset to arrow.
2020-06-28T21:32:46Z
https://github.com/huggingface/datasets/issues/129#issuecomment-650824711
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDY1MDgyNDcxMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/650824711/reactions
2020-06-28T21:32:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/650824711
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
NQ was added in #427 🎉
2020-07-23T13:21:01Z
https://github.com/huggingface/datasets/issues/129#issuecomment-663003135
https://api.github.com/repos/huggingface/datasets/issues/129
MDEyOklzc3VlQ29tbWVudDY2MzAwMzEzNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/663003135/reactions
2020-07-23T13:21:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/663003135
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Would be great to have https://github.com/google-research-datasets/natural-questions as an alternative to SQuAD.