fix squad metric format
MEMBER
One thing for SQuAD is that I wanted to be able to use the SQuAD dataset directly in the metrics and I'm not sure it will be possible with this format.

(maybe it's not really possible in general though)
2020-05-19T21:26:10Z
https://github.com/huggingface/datasets/pull/171#issuecomment-631091464
https://api.github.com/repos/huggingface/datasets/issues/171
MDEyOklzc3VlQ29tbWVudDYzMTA5MTQ2NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/631091464/reactions
2020-05-19T21:42:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/631091464
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
This is kinda related to one thing I had in mind which is that we may want to be able to dump our model predictions in a `Dataset` as well so that we don't keep them in memory (and we can export them in a nice format later as well when we will have a serialization formats).

Maybe this is overkill though, I haven't fully wraped my head around this.
2020-05-19T21:45:42Z
https://github.com/huggingface/datasets/pull/171#issuecomment-631100434
https://api.github.com/repos/huggingface/datasets/issues/171
MDEyOklzc3VlQ29tbWVudDYzMTEwMDQzNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/631100434/reactions
2020-05-19T21:45:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/631100434
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
I'm also perfectly fine with merging this PR in the current state and working on a larger scope later.
2020-05-19T21:46:48Z
https://github.com/huggingface/datasets/pull/171#issuecomment-631100940
https://api.github.com/repos/huggingface/datasets/issues/171
MDEyOklzc3VlQ29tbWVudDYzMTEwMDk0MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/631100940/reactions
2020-05-19T21:46:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/631100940
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
This is the format needed to run the official script directly. The format of the squad dataset is different from the input of the metric. 

> One thing for SQuAD is that I wanted to be able to use the SQuAD dataset directly in the metrics and I'm not sure it will be possible with this format.
> 
> (maybe it's not really possible in general though)

Ok I see. I'll try to use the same format
2020-05-20T15:23:34Z
https://github.com/huggingface/datasets/pull/171#issuecomment-631545055
https://api.github.com/repos/huggingface/datasets/issues/171
MDEyOklzc3VlQ29tbWVudDYzMTU0NTA1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/631545055/reactions
2020-05-20T15:23:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/631545055
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Ok with this update I changed the format to fit the squad dataset format.
Now you can do:
```python
squad_dset = nlp.load_dataset("squad")
squad_metric = nlp.load_metric("/Users/quentinlhoest/Desktop/hf/nlp-bis/metrics/squad")
predictions = [
    {"id": v["id"], "prediction_text": v["answers"]["text"][0]}  # take first possible answer
    for v in squad_dset["validation"]
]
squad_metric.compute(predictions, squad_dset["validation"])
```
2020-05-20T15:36:58Z
https://github.com/huggingface/datasets/pull/171#issuecomment-631553593
https://api.github.com/repos/huggingface/datasets/issues/171
MDEyOklzc3VlQ29tbWVudDYzMTU1MzU5Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/631553593/reactions
2020-05-20T15:36:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/631553593
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
The format of the squad metric was wrong.
This should fix #143 

I tested with
```python3
predictions = [
    {'id': '56be4db0acb8001400a502ec', 'prediction_text': 'Denver Broncos'}
]
references = [
    {'answers': [{'text': 'Denver Broncos'}], 'id': '56be4db0acb8001400a502ec'}
]
```