Add SubjQA dataset
MEMBER
I'm not sure why the windows test fails, but looking at the logs it looks like some caching issue on one of the metrics ... maybe re-run and 🤞 ?
2021-05-02T16:27:39Z
https://github.com/huggingface/datasets/pull/2302#issuecomment-830835021
https://api.github.com/repos/huggingface/datasets/issues/2302
MDEyOklzc3VlQ29tbWVudDgzMDgzNTAyMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/830835021/reactions
2021-05-02T16:27:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/830835021
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
MEMBER
Hi @lewtun, thanks for adding this dataset!

If the dataset is going to be referenced heavily, I think it's worth spending some time to make the dataset card really great :) To start, the information that is currently in the `Data collection` paragraph should probably be organized in the `Dataset Creation` section.

Here's a link to the [relevant section of the guide](https://github.com/huggingface/datasets/blob/master/templates/README_guide.md#dataset-creation), let me know if you have any questions!
2021-05-05T16:56:04Z
https://github.com/huggingface/datasets/pull/2302#issuecomment-832853478
https://api.github.com/repos/huggingface/datasets/issues/2302
MDEyOklzc3VlQ29tbWVudDgzMjg1MzQ3OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/832853478/reactions
2021-05-05T16:56:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/832853478
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
MEMBER
> If the dataset is going to be referenced heavily, I think it's worth spending some time to make the dataset card really great :) To start, the information that is currently in the `Data collection` paragraph should probably be organized in the `Dataset Creation` section.

great idea @yjernite! i've added some extra information / moved things as you suggest and will wrap up the rest tomorrow :)
2021-05-05T19:55:18Z
https://github.com/huggingface/datasets/pull/2302#issuecomment-832965952
https://api.github.com/repos/huggingface/datasets/issues/2302
MDEyOklzc3VlQ29tbWVudDgzMjk2NTk1Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/832965952/reactions
2021-05-05T19:55:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/832965952
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
MEMBER
hi @yjernite and @lhoestq, i've fleshed out the dataset card and think this is now ready for another round of review!
2021-05-06T07:42:17Z
https://github.com/huggingface/datasets/pull/2302#issuecomment-833305734
https://api.github.com/repos/huggingface/datasets/issues/2302
MDEyOklzc3VlQ29tbWVudDgzMzMwNTczNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/833305734/reactions
2021-05-06T07:42:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/833305734
https://avatars.githubusercontent.com/u/26859204?v=4
https://api.github.com/users/lewtun/events{/privacy}
https://api.github.com/users/lewtun/followers
https://api.github.com/users/lewtun/following{/other_user}
https://api.github.com/users/lewtun/gists{/gist_id}
https://github.com/lewtun
lewtun
MDQ6VXNlcjI2ODU5MjA0
https://api.github.com/users/lewtun/orgs
https://api.github.com/users/lewtun/received_events
https://api.github.com/users/lewtun/repos
https://api.github.com/users/lewtun/starred{/owner}{/repo}
https://api.github.com/users/lewtun/subscriptions
User
https://api.github.com/users/lewtun
public
Hello datasetters 🙂!

Here's an interesting dataset about extractive question-answering on _subjective_ product / restaurant reviews. It's quite challenging for models fine-tuned on SQuAD and provides a nice example of domain adaptation (i.e. fine-tuning a SQuAD model on this domain gives better performance).

I found a bug in the start/end indices that I've proposed a fix for here: https://github.com/megagonlabs/SubjQA/pull/2

Unfortunately, the dataset creators are unresponsive, so for now I am using my fork as the source. Will update the URL if/when the creators respond.