Adding adversarialQA dataset
MEMBER
Oh that's a really cool one, we'll review/merge it soon!

In the meantime, do you have any specific positive/negative feedback on the process of adding a datasets Max?
Did you follow the instruction in the [detailed step-by-step](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md)?
2021-01-08T22:08:08Z
https://github.com/huggingface/datasets/pull/1714#issuecomment-757023188
https://api.github.com/repos/huggingface/datasets/issues/1714
MDEyOklzc3VlQ29tbWVudDc1NzAyMzE4OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/757023188/reactions
2021-01-08T22:08:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/757023188
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
CONTRIBUTOR
Thanks Thom, been a while, hope all is well!

Yes, I followed the step by step instructions and found them pretty straightforward. The only things I wasn't sure of were what should go into the YAML tags field for the dataset card, and whether there was a list of options somewhere (maybe akin to the metrics?) of the possible supported tasks. I found the rest very intuitive and the automated metadata and dummy data generation very handy. Thanks!
2021-01-09T00:04:50Z
https://github.com/huggingface/datasets/pull/1714#issuecomment-757055443
https://api.github.com/repos/huggingface/datasets/issues/1714
MDEyOklzc3VlQ29tbWVudDc1NzA1NTQ0Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/757055443/reactions
2021-01-09T00:04:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/757055443
https://avatars.githubusercontent.com/u/15869827?v=4
https://api.github.com/users/maxbartolo/events{/privacy}
https://api.github.com/users/maxbartolo/followers
https://api.github.com/users/maxbartolo/following{/other_user}
https://api.github.com/users/maxbartolo/gists{/gist_id}
https://github.com/maxbartolo
maxbartolo
MDQ6VXNlcjE1ODY5ODI3
https://api.github.com/users/maxbartolo/orgs
https://api.github.com/users/maxbartolo/received_events
https://api.github.com/users/maxbartolo/repos
https://api.github.com/users/maxbartolo/starred{/owner}{/repo}
https://api.github.com/users/maxbartolo/subscriptions
User
https://api.github.com/users/maxbartolo
public
MEMBER
Good point! pinging @yjernite here so he can improve this part!
2021-01-09T09:35:28Z
https://github.com/huggingface/datasets/pull/1714#issuecomment-757123216
https://api.github.com/repos/huggingface/datasets/issues/1714
MDEyOklzc3VlQ29tbWVudDc1NzEyMzIxNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/757123216/reactions
2021-01-09T09:35:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/757123216
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
@maxbartolo cool addition!

For the YAML tag, you should use the tagging app we provide to choose from a drop-down menu:
https://github.com/huggingface/datasets-tagging

The process is described toward the end of the [step-by-step guide](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#tag-the-dataset-and-write-the-dataset-card), do you have any suggestions for making it easier to find?

Otherwise, the dataset card is really cool, thanks for making it so complete!

2021-01-11T14:01:46Z
https://github.com/huggingface/datasets/pull/1714#issuecomment-757970567
https://api.github.com/repos/huggingface/datasets/issues/1714
MDEyOklzc3VlQ29tbWVudDc1Nzk3MDU2Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/757970567/reactions
2021-01-11T14:03:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/757970567
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
CONTRIBUTOR
@yjernite

Thanks, YAML tags added. I think my main issue was with the flow of the [step-by-step guide](https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md). For example, the [card creator](https://huggingface.co/datasets/card-creator/) is introduced in Step 4, right after creating an empty directory for your dataset. The first field it requires are the YAML tags, which (at least for me) was the last step of the process.

I'd suggest having the guide structured in the same order as the creation process. For me it was something like:
- Step 1: Preparing your env
- Step 2: Write the loading/processing code
- Step 3: Automatically generate dummy data and `dataset_infos.json`
- Step 4: Tag the dataset
- Step 5: Write the dataset card using the [card creator](https://huggingface.co/datasets/card-creator/)
- Step 6: Open a Pull Request on the main HuggingFace repo and share your work!!

Thanks again!
2021-01-11T14:45:50Z
https://github.com/huggingface/datasets/pull/1714#issuecomment-757997119
https://api.github.com/repos/huggingface/datasets/issues/1714
MDEyOklzc3VlQ29tbWVudDc1Nzk5NzExOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/757997119/reactions
2021-01-11T14:46:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/757997119
https://avatars.githubusercontent.com/u/15869827?v=4
https://api.github.com/users/maxbartolo/events{/privacy}
https://api.github.com/users/maxbartolo/followers
https://api.github.com/users/maxbartolo/following{/other_user}
https://api.github.com/users/maxbartolo/gists{/gist_id}
https://github.com/maxbartolo
maxbartolo
MDQ6VXNlcjE1ODY5ODI3
https://api.github.com/users/maxbartolo/orgs
https://api.github.com/users/maxbartolo/received_events
https://api.github.com/users/maxbartolo/repos
https://api.github.com/users/maxbartolo/starred{/owner}{/repo}
https://api.github.com/users/maxbartolo/subscriptions
User
https://api.github.com/users/maxbartolo
public
Adding the adversarialQA dataset (https://adversarialqa.github.io/) from Beat the AI (https://arxiv.org/abs/2002.00293)