Fix duplicate keys
NONE
- @jplu 
2021-05-08T21:47:30Z
https://github.com/huggingface/datasets/pull/2333#issuecomment-835530230
https://api.github.com/repos/huggingface/datasets/issues/2333
MDEyOklzc3VlQ29tbWVudDgzNTUzMDIzMA==
https://api.github.com/repos/huggingface/datasets/issues/comments/835530230/reactions
2021-05-08T21:47:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/835530230
https://avatars.githubusercontent.com/u/71971234?v=4
https://api.github.com/users/aDrIaNo34500/events{/privacy}
https://api.github.com/users/aDrIaNo34500/followers
https://api.github.com/users/aDrIaNo34500/following{/other_user}
https://api.github.com/users/aDrIaNo34500/gists{/gist_id}
https://github.com/aDrIaNo34500
aDrIaNo34500
MDQ6VXNlcjcxOTcxMjM0
https://api.github.com/users/aDrIaNo34500/orgs
https://api.github.com/users/aDrIaNo34500/received_events
https://api.github.com/users/aDrIaNo34500/repos
https://api.github.com/users/aDrIaNo34500/starred{/owner}{/repo}
https://api.github.com/users/aDrIaNo34500/subscriptions
User
https://api.github.com/users/aDrIaNo34500
public
As noticed in https://github.com/huggingface/datasets/pull/2245, many datasets yield duplicate keys.
Most of the time it was because the counter used for ids were reset at each new data file.