Ignore duplicate keys if `ignore_verifications=True`
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_3868). All of your documentation changes will be reflected on that endpoint.
2022-03-08T17:20:16Z
https://github.com/huggingface/datasets/pull/3868#issuecomment-1062016622
https://api.github.com/repos/huggingface/datasets/issues/3868
IC_kwDODunzps4_TRZu
https://api.github.com/repos/huggingface/datasets/issues/comments/1062016622/reactions
2022-03-08T17:20:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1062016622
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
Cool thanks ! Could you add a test please ?
2022-03-09T11:14:57Z
https://github.com/huggingface/datasets/pull/3868#issuecomment-1062814009
https://api.github.com/repos/huggingface/datasets/issues/3868
IC_kwDODunzps4_WUE5
https://api.github.com/repos/huggingface/datasets/issues/comments/1062814009/reactions
2022-03-09T11:14:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1062814009
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Currently, it's impossible to generate a dataset if some keys from `_generate_examples` are duplicated. This PR allows skipping the check for duplicate keys if `ignore_verifications` is set to `True`.  