Adding Qanta (Quizbowl) Dataset
CONTRIBUTOR
Hi @EntilZha - sorry for waiting so long until taking action here. We created a new command and a new recipe of how to add dummy_data. Can you maybe rebase to `master` as explained in 7. of https://github.com/huggingface/nlp/blob/master/CONTRIBUTING.md#how-to-contribute-to-nlp and check that your dummy data is correct following the instructions here: https://github.com/huggingface/nlp/blob/master/CONTRIBUTING.md#how-to-add-a-dataset ? 

If the tests described in 5. of https://github.com/huggingface/nlp/blob/master/CONTRIBUTING.md#how-to-add-a-dataset pass we can merge the PR :-) 
2020-05-22T14:11:00Z
https://github.com/huggingface/datasets/pull/169#issuecomment-632713390
https://api.github.com/repos/huggingface/datasets/issues/169
MDEyOklzc3VlQ29tbWVudDYzMjcxMzM5MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/632713390/reactions
2020-05-22T14:11:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/632713390
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
I updated to the most recent master and followed the steps, but still having the similar error where it can't find the correct file since the path to the directory is given, rather than the individual files within them. This still something wrong about how I'm inputting the data or how the tests are reading it?
2020-05-25T19:18:08Z
https://github.com/huggingface/datasets/pull/169#issuecomment-633690386
https://api.github.com/repos/huggingface/datasets/issues/169
MDEyOklzc3VlQ29tbWVudDYzMzY5MDM4Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/633690386/reactions
2020-05-25T19:18:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/633690386
https://avatars.githubusercontent.com/u/1382460?v=4
https://api.github.com/users/EntilZha/events{/privacy}
https://api.github.com/users/EntilZha/followers
https://api.github.com/users/EntilZha/following{/other_user}
https://api.github.com/users/EntilZha/gists{/gist_id}
https://github.com/EntilZha
EntilZha
MDQ6VXNlcjEzODI0NjA=
https://api.github.com/users/EntilZha/orgs
https://api.github.com/users/EntilZha/received_events
https://api.github.com/users/EntilZha/repos
https://api.github.com/users/EntilZha/starred{/owner}{/repo}
https://api.github.com/users/EntilZha/subscriptions
User
https://api.github.com/users/EntilZha
public
CONTRIBUTOR
It's the dummy_data structure. You actually have to call the dummy data file name `dummy_data` (not .json anything). So there should not be a `dummy_data` folder but for each config only a `dummy_data` which contains your json dummy data. Can you maybe try once more - if it doesn't work I do it for you :-). 
2020-05-25T19:57:04Z
https://github.com/huggingface/datasets/pull/169#issuecomment-633699972
https://api.github.com/repos/huggingface/datasets/issues/169
MDEyOklzc3VlQ29tbWVudDYzMzY5OTk3Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/633699972/reactions
2020-05-25T19:57:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/633699972
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
CONTRIBUTOR
Would that work if there are multiple files? In my case, I'm including something similar to squad 1.0/2.0 where we have the main dataset + an additional challenge set in different files. Would I have the zip decompress to two files in that case?
2020-05-25T20:11:19Z
https://github.com/huggingface/datasets/pull/169#issuecomment-633703392
https://api.github.com/repos/huggingface/datasets/issues/169
MDEyOklzc3VlQ29tbWVudDYzMzcwMzM5Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/633703392/reactions
2020-05-25T20:11:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/633703392
https://avatars.githubusercontent.com/u/1382460?v=4
https://api.github.com/users/EntilZha/events{/privacy}
https://api.github.com/users/EntilZha/followers
https://api.github.com/users/EntilZha/following{/other_user}
https://api.github.com/users/EntilZha/gists{/gist_id}
https://github.com/EntilZha
EntilZha
MDQ6VXNlcjEzODI0NjA=
https://api.github.com/users/EntilZha/orgs
https://api.github.com/users/EntilZha/received_events
https://api.github.com/users/EntilZha/repos
https://api.github.com/users/EntilZha/starred{/owner}{/repo}
https://api.github.com/users/EntilZha/subscriptions
User
https://api.github.com/users/EntilZha
public
CONTRIBUTOR
This dataset was actually a special case. It helped us improve the  dummy data instructions :-), see #195 .Close this PR and merge #194.
2020-05-26T12:52:31Z
https://github.com/huggingface/datasets/pull/169#issuecomment-634005231
https://api.github.com/repos/huggingface/datasets/issues/169
MDEyOklzc3VlQ29tbWVudDYzNDAwNTIzMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/634005231/reactions
2020-05-26T12:52:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/634005231
https://avatars.githubusercontent.com/u/23423619?v=4
https://api.github.com/users/patrickvonplaten/events{/privacy}
https://api.github.com/users/patrickvonplaten/followers
https://api.github.com/users/patrickvonplaten/following{/other_user}
https://api.github.com/users/patrickvonplaten/gists{/gist_id}
https://github.com/patrickvonplaten
patrickvonplaten
MDQ6VXNlcjIzNDIzNjE5
https://api.github.com/users/patrickvonplaten/orgs
https://api.github.com/users/patrickvonplaten/received_events
https://api.github.com/users/patrickvonplaten/repos
https://api.github.com/users/patrickvonplaten/starred{/owner}{/repo}
https://api.github.com/users/patrickvonplaten/subscriptions
User
https://api.github.com/users/patrickvonplaten
public
This PR adds the qanta question answering datasets from [Quizbowl: The Case for Incremental Question Answering](https://arxiv.org/abs/1904.04792) and [Trick Me If You Can: Human-in-the-loop Generation of Adversarial Question Answering Examples](https://www.aclweb.org/anthology/Q19-1029/) (adversarial fold)

This partially continues a discussion around fixing dummy data from https://github.com/huggingface/nlp/issues/161

I ran the following code to double check that it works and did some sanity checks on the output. The majority of the code itself is from our `allennlp` version of the dataset reader.

```python
import nlp
# Default is full question
data = nlp.load_dataset('./datasets/qanta') 
# Four configs
# Primarily useful for training
data = nlp.load_dataset('./datasets/qanta', 'mode=sentences,char_skip=25')  
# Primarily used in evaluation
data = nlp.load_dataset('./datasets/qanta', 'mode=first,char_skip=25')  
data = nlp.load_dataset('./datasets/qanta', 'mode=full,char_skip=25')  
# Primarily useful in evaluation and "live" play
data = nlp.load_dataset('./datasets/qanta', 'mode=runs,char_skip=25')  
```