Add ReFreSD dataset
MEMBER
Cool dataset! Replying in-line:

> This PR adds the **ReFreSD dataset**.
> The original data is hosted [on this github repo](https://github.com/Elbria/xling-SemDiv) and we use the `REFreSD_rationale` to expose all the data.
> 
> Need feedback on:
> 
> * I couldn't generate the dummy data. The file we download is a tsv file, but without extension, I suppose this is the problem. I'm sure there is a simple trick to make this work.

you can use `--match_text_files` in the dummy data generation:
`python datasets-cli dummy_data datasets/refresd --auto_generate --match_text_files "REFreSD_rationale"`

> * The feature names.
>   
>   * I don't know if it's better to stick to the classic `sentence1`, `sentence2` or to `sentence_en`, `sentence_fr` to be more explicit.

It would actually be even better to use the `Translation` feature here to replace best:
`"sentence_pair": datasets.Translation(languages=['en', 'fr']),`

Then during `_generate_examples` this filed should look like"
`{"sentence_pair": {"fr": french, "en": english}}`

>   * There is a binary label (called `label`, no problem here), and a 3-class label called `#3_labels` in the original tsv. I changed it to `all_labels` but I'm sure there is better.
Looks good!

> * The rationales are lists of integers, extracted as a string at first. I wonder what's the best way to treat them, any idea? Also, I couldn't manage to make a `Sequence` of `int8` but I'm sure I've missed something simple.

Having the feature declared as `"rationale_en": datasets.Sequence(datasets.Value("int32"))` should work

> 
> Thanks in advance

Hope that helps you out! Don't forget to `make style`, rebase from master, and run all the tests before pushing again! You will also need to add a `README.md` as described in the guide:
https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#tag-the-dataset-and-write-the-dataset-card
2020-12-05T20:14:09Z
https://github.com/huggingface/datasets/pull/1139#issuecomment-739395413
https://api.github.com/repos/huggingface/datasets/issues/1139
MDEyOklzc3VlQ29tbWVudDczOTM5NTQxMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/739395413/reactions
2020-12-05T20:14:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739395413
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
CONTRIBUTOR
Thanks a lot for the answer, that does help a lot !
I opened a PR for a License in the original repo so I was waiting for that for the model card. If there is no news on Monday, I'll add it without License. 
2020-12-05T21:03:05Z
https://github.com/huggingface/datasets/pull/1139#issuecomment-739415783
https://api.github.com/repos/huggingface/datasets/issues/1139
MDEyOklzc3VlQ29tbWVudDczOTQxNTc4Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/739415783/reactions
2020-12-05T21:03:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739415783
https://avatars.githubusercontent.com/u/18496796?v=4
https://api.github.com/users/mpariente/events{/privacy}
https://api.github.com/users/mpariente/followers
https://api.github.com/users/mpariente/following{/other_user}
https://api.github.com/users/mpariente/gists{/gist_id}
https://github.com/mpariente
mpariente
MDQ6VXNlcjE4NDk2Nzk2
https://api.github.com/users/mpariente/orgs
https://api.github.com/users/mpariente/received_events
https://api.github.com/users/mpariente/repos
https://api.github.com/users/mpariente/starred{/owner}{/repo}
https://api.github.com/users/mpariente/subscriptions
User
https://api.github.com/users/mpariente
public
MEMBER
Looks good! It looks like it might need a rebase to pass the tests. Once you do that, should be good to go!
2020-12-07T00:22:01Z
https://github.com/huggingface/datasets/pull/1139#issuecomment-739592941
https://api.github.com/repos/huggingface/datasets/issues/1139
MDEyOklzc3VlQ29tbWVudDczOTU5Mjk0MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/739592941/reactions
2020-12-07T00:22:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739592941
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
This PR adds the **ReFreSD dataset**. 
The original data is hosted [on this github repo](https://github.com/Elbria/xling-SemDiv) and we use the `REFreSD_rationale` to expose all the data. 


Need feedback on:
- I couldn't generate the dummy data. The file we download is a tsv file, but without extension, I suppose this is the problem. I'm sure there is a simple trick to make this work. 
- The feature names. 
  - I don't know if it's better to stick to the classic `sentence1`, `sentence2` or to `sentence_en`, `sentence_fr` to be more explicit. 
  - There is a binary label (called `label`, no problem here), and a 3-class label called `#3_labels` in the original tsv. I changed it to `all_labels` but I'm sure there is better. 
- The rationales are lists of integers, extracted as a string at first. I wonder what's the best way to treat them, any idea? Also, I couldn't manage to make a `Sequence` of `int8` but I'm sure I've missed something simple. 

Thanks in advance 