Add SQuADShifts dataset
MEMBER
Very cool to have this dataset, thank you for adding it :)
2020-06-30T17:07:25Z
https://github.com/huggingface/datasets/pull/325#issuecomment-651925598
https://api.github.com/repos/huggingface/datasets/issues/325
MDEyOklzc3VlQ29tbWVudDY1MTkyNTU5OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/651925598/reactions
2020-06-30T17:07:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/651925598
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
This PR adds the four new variants of the SQuAD dataset used in [The Effect of Natural Distribution Shift on Question Answering Models](https://arxiv.org/abs/2004.14444) to facilitate evaluating model robustness to distribution shift.