Add QuALITY dataset
CONTRIBUTOR
I'll take this one if no one hasn't yet!
2021-12-28T15:17:05Z
https://github.com/huggingface/datasets/issues/3441#issuecomment-1002153753
https://api.github.com/repos/huggingface/datasets/issues/3441
IC_kwDODunzps47u6cZ
https://api.github.com/repos/huggingface/datasets/issues/comments/1002153753/reactions
2021-12-28T15:17:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1002153753
https://avatars.githubusercontent.com/u/25360440?v=4
https://api.github.com/users/jaketae/events{/privacy}
https://api.github.com/users/jaketae/followers
https://api.github.com/users/jaketae/following{/other_user}
https://api.github.com/users/jaketae/gists{/gist_id}
https://github.com/jaketae
jaketae
MDQ6VXNlcjI1MzYwNDQw
https://api.github.com/users/jaketae/orgs
https://api.github.com/users/jaketae/received_events
https://api.github.com/users/jaketae/repos
https://api.github.com/users/jaketae/starred{/owner}{/repo}
https://api.github.com/users/jaketae/subscriptions
User
https://api.github.com/users/jaketae
public
## Adding a Dataset
- **Name:** QuALITY
- **Description:** A challenging question answering with very long contexts (Twitter [thread](https://twitter.com/sleepinyourhat/status/1471225421794529281?s=20))
- **Paper:** No ArXiv link yet, but draft is [here](https://github.com/nyu-mll/quality/blob/main/quality_preprint.pdf)
- **Data:** GitHub repo [here](https://github.com/nyu-mll/quality)
- **Motivation:** This dataset would serve as a nice way to benchmark long-range Transformer models like BigBird, Longformer and their descendants. In particular, it would be very interesting to see how the S4 model fares on this given it's impressive performance on the Long Range Arena

Instructions to add a new dataset can be found [here](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md).
