Add long answer candidates to natural questions dataset
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-05-24T08:24:22Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1135563416
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5Dr1KY
https://api.github.com/repos/huggingface/datasets/issues/comments/1135563416/reactions
2022-07-26T20:30:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1135563416
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
Once we have added `long_answer_candidates` maybe it would be worth to also add the missing `candidate_index` (inside `long_answer`). What do you think, @seirasto ?
2022-05-31T13:33:31Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1142143220
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5EE7j0
https://api.github.com/repos/huggingface/datasets/issues/comments/1142143220/reactions
2022-05-31T13:33:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1142143220
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
Also note the "Data Fields" section in the README is missing the `long_answer` field.

Moreover, there is no instance example in "Data Instances" section.
2022-05-31T13:35:12Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1142145209
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5EE8C5
https://api.github.com/repos/huggingface/datasets/issues/comments/1142145209/reactions
2022-05-31T13:35:12Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1142145209
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
We could either make these fixes in this PR or in a subsequent PR.
2022-05-31T13:35:47Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1142145898
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5EE8Nq
https://api.github.com/repos/huggingface/datasets/issues/comments/1142145898/reactions
2022-05-31T13:35:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1142145898
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
CONTRIBUTOR
@albertvillanova I've added the missing fields and updated the README to include a data instance and some other things. 
2022-06-01T14:50:58Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1143710930
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5EK6TS
https://api.github.com/repos/huggingface/datasets/issues/comments/1143710930/reactions
2022-06-01T14:50:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1143710930
https://avatars.githubusercontent.com/u/4257308?v=4
https://api.github.com/users/seirasto/events{/privacy}
https://api.github.com/users/seirasto/followers
https://api.github.com/users/seirasto/following{/other_user}
https://api.github.com/users/seirasto/gists{/gist_id}
https://github.com/seirasto
seirasto
MDQ6VXNlcjQyNTczMDg=
https://api.github.com/users/seirasto/orgs
https://api.github.com/users/seirasto/received_events
https://api.github.com/users/seirasto/repos
https://api.github.com/users/seirasto/starred{/owner}{/repo}
https://api.github.com/users/seirasto/subscriptions
User
https://api.github.com/users/seirasto
public
CONTRIBUTOR
Great! I've made the updates to align the README. Please let me know if I missed anything.
2022-06-01T15:59:42Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1143794212
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5ELOok
https://api.github.com/repos/huggingface/datasets/issues/comments/1143794212/reactions
2022-06-01T15:59:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1143794212
https://avatars.githubusercontent.com/u/4257308?v=4
https://api.github.com/users/seirasto/events{/privacy}
https://api.github.com/users/seirasto/followers
https://api.github.com/users/seirasto/following{/other_user}
https://api.github.com/users/seirasto/gists{/gist_id}
https://github.com/seirasto
seirasto
MDQ6VXNlcjQyNTczMDg=
https://api.github.com/users/seirasto/orgs
https://api.github.com/users/seirasto/received_events
https://api.github.com/users/seirasto/repos
https://api.github.com/users/seirasto/starred{/owner}{/repo}
https://api.github.com/users/seirasto/subscriptions
User
https://api.github.com/users/seirasto
public
MEMBER
As there were many minor little fixes, I thought it would be easier to fix them directly.
2022-06-01T16:57:25Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1143876548
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5ELivE
https://api.github.com/repos/huggingface/datasets/issues/comments/1143876548/reactions
2022-06-01T16:57:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1143876548
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
I think the loading script is OK now. If it is also validated by another datasets maintainer, I could run the generation of the pre-processed data and then merge this PR into master (once all the tests are green).

CC: @lhoestq 
2022-06-08T17:22:01Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1150190443
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5EjoNr
https://api.github.com/repos/huggingface/datasets/issues/comments/1150190443/reactions
2022-06-08T17:22:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1150190443
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
It looks good to me, thanks @seirasto !
2022-06-09T09:27:35Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1150889122
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5EmSyi
https://api.github.com/repos/huggingface/datasets/issues/comments/1150889122/reactions
2022-06-09T09:27:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1150889122
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
I have merged the master branch, so that we include all the fixes on Apache Beam + Google Dataflow.
2022-06-17T06:38:42Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1158544252
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5FDft8
https://api.github.com/repos/huggingface/datasets/issues/comments/1158544252/reactions
2022-06-17T06:38:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1158544252
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
Pre-processing is running!

Already finished for "dev" config:
```python
In [2]: ds = load_dataset("datasets/natural_questions", "dev")

In [3]: ds
Out[3]: 
DatasetDict({
    validation: Dataset({
        features: ['id', 'document', 'question', 'long_answer_candidates', 'annotations'],
        num_rows: 7830
    })
})
```
2022-06-17T11:25:42Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1158776818
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5FEYfy
https://api.github.com/repos/huggingface/datasets/issues/comments/1158776818/reactions
2022-06-17T11:25:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1158776818
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
There is an issue while running the preprocessing for the "default" (train+dev) config. Train data files are larger than than dev ones and workers run out of memory.

I'm opening a separate issue to handle this problem: #4525
2022-06-20T07:16:49Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1160065516
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5FJTHs
https://api.github.com/repos/huggingface/datasets/issues/comments/1160065516/reactions
2022-06-20T07:28:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1160065516
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
@seirasto is proposing uploading their preprocessed data files to our Datasets bucket.

I think @lhoestq can give a more informed answer about authentication requirements.
2022-06-28T14:38:58Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1168812963
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5Fqquj
https://api.github.com/repos/huggingface/datasets/issues/comments/1168812963/reactions
2022-06-28T14:38:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1168812963
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
Now that the data fiels are uploaded, can you merge the `main` branch into yours to re-trigger the CI @seirasto please ? :) Then I think we can merge if it's good for you @albertvillanova 
2022-07-26T14:37:32Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1195569246
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5HQvBe
https://api.github.com/repos/huggingface/datasets/issues/comments/1195569246/reactions
2022-07-26T14:37:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1195569246
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Merge is done! I think someone needs to approve the CI to run :) 
2022-07-26T14:51:20Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1195586042
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5HQzH6
https://api.github.com/repos/huggingface/datasets/issues/comments/1195586042/reactions
2022-07-26T14:51:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1195586042
https://avatars.githubusercontent.com/u/4257308?v=4
https://api.github.com/users/seirasto/events{/privacy}
https://api.github.com/users/seirasto/followers
https://api.github.com/users/seirasto/following{/other_user}
https://api.github.com/users/seirasto/gists{/gist_id}
https://github.com/seirasto
seirasto
MDQ6VXNlcjQyNTczMDg=
https://api.github.com/users/seirasto/orgs
https://api.github.com/users/seirasto/received_events
https://api.github.com/users/seirasto/repos
https://api.github.com/users/seirasto/starred{/owner}{/repo}
https://api.github.com/users/seirasto/subscriptions
User
https://api.github.com/users/seirasto
public
MEMBER
Can you run `make style` to fix the code formatting required by the CI please ?
2022-07-26T15:10:35Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1195610504
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5HQ5GI
https://api.github.com/repos/huggingface/datasets/issues/comments/1195610504/reactions
2022-07-26T15:10:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1195610504
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Thanks @albertvillanova! I've committed all your suggestions.
2022-07-26T16:16:16Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1195693423
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5HRNVv
https://api.github.com/repos/huggingface/datasets/issues/comments/1195693423/reactions
2022-07-26T16:16:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1195693423
https://avatars.githubusercontent.com/u/4257308?v=4
https://api.github.com/users/seirasto/events{/privacy}
https://api.github.com/users/seirasto/followers
https://api.github.com/users/seirasto/following{/other_user}
https://api.github.com/users/seirasto/gists{/gist_id}
https://github.com/seirasto
seirasto
MDQ6VXNlcjQyNTczMDg=
https://api.github.com/users/seirasto/orgs
https://api.github.com/users/seirasto/received_events
https://api.github.com/users/seirasto/repos
https://api.github.com/users/seirasto/starred{/owner}{/repo}
https://api.github.com/users/seirasto/subscriptions
User
https://api.github.com/users/seirasto
public
MEMBER
The CI is green. I'm merging this PR.
2022-07-26T20:18:31Z
https://github.com/huggingface/datasets/pull/4368#issuecomment-1195936921
https://api.github.com/repos/huggingface/datasets/issues/4368
IC_kwDODunzps5HSIyZ
https://api.github.com/repos/huggingface/datasets/issues/comments/1195936921/reactions
2022-07-26T20:18:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1195936921
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
This is a modification of the Natural Questions dataset to include missing information specifically related to long answer candidates. (See here: https://github.com/google-research-datasets/natural-questions#long-answer-candidates). This information is important to ensure consistent comparison with prior work. It does not disturb the rest of the format . @lhoestq @albertvillanova 