Add OpenPI Dataset
MEMBER
Hi @Bharat123rox ! It looks like some of the dummy data is broken or missing. Did you auto-generate it? Does the local test pass for you?
2020-12-05T22:02:19Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-739422036
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDczOTQyMjAzNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/739422036/reactions
2020-12-05T22:02:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739422036
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
CONTRIBUTOR
@yjernite requesting you to have a look as to why the tests are failing only on Windows, there seems to be a backslash error somewhere, could it be the result of `os.path.join` and what should be the fix for this?
2020-12-06T16:42:06Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-739528545
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDczOTUyODU0NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/739528545/reactions
2020-12-06T16:42:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739528545
https://avatars.githubusercontent.com/u/13381361?v=4
https://api.github.com/users/bharatr21/events{/privacy}
https://api.github.com/users/bharatr21/followers
https://api.github.com/users/bharatr21/following{/other_user}
https://api.github.com/users/bharatr21/gists{/gist_id}
https://github.com/bharatr21
bharatr21
MDQ6VXNlcjEzMzgxMzYx
https://api.github.com/users/bharatr21/orgs
https://api.github.com/users/bharatr21/received_events
https://api.github.com/users/bharatr21/repos
https://api.github.com/users/bharatr21/starred{/owner}{/repo}
https://api.github.com/users/bharatr21/subscriptions
User
https://api.github.com/users/bharatr21
public
CONTRIBUTOR
This is the `black` output locally:
```
(datasets_env) datasets (openpi) > black --check --line-length 119 --target-version py36 datasets/openpi/
All done! ✨ 🍰 ✨
1 file would be left unchanged.
```
2020-12-06T17:32:30Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-739535604
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDczOTUzNTYwNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/739535604/reactions
2020-12-06T17:32:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739535604
https://avatars.githubusercontent.com/u/13381361?v=4
https://api.github.com/users/bharatr21/events{/privacy}
https://api.github.com/users/bharatr21/followers
https://api.github.com/users/bharatr21/following{/other_user}
https://api.github.com/users/bharatr21/gists{/gist_id}
https://github.com/bharatr21
bharatr21
MDQ6VXNlcjEzMzgxMzYx
https://api.github.com/users/bharatr21/orgs
https://api.github.com/users/bharatr21/received_events
https://api.github.com/users/bharatr21/repos
https://api.github.com/users/bharatr21/starred{/owner}{/repo}
https://api.github.com/users/bharatr21/subscriptions
User
https://api.github.com/users/bharatr21
public
MEMBER
Can you check your version of black (should be `20.8b1`) and run `make style again`? (And don't forget to rebase before pushing ;) )

The other test was a time-out error so should be good on the next commit
2020-12-07T00:13:11Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-739591028
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDczOTU5MTAyOA==
https://api.github.com/repos/huggingface/datasets/issues/comments/739591028/reactions
2020-12-07T00:13:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739591028
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
CONTRIBUTOR
Thanks @yjernite the CI tests finally passed!!
2020-12-07T04:21:33Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-739653435
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDczOTY1MzQzNQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/739653435/reactions
2020-12-07T04:21:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739653435
https://avatars.githubusercontent.com/u/13381361?v=4
https://api.github.com/users/bharatr21/events{/privacy}
https://api.github.com/users/bharatr21/followers
https://api.github.com/users/bharatr21/following{/other_user}
https://api.github.com/users/bharatr21/gists{/gist_id}
https://github.com/bharatr21
bharatr21
MDQ6VXNlcjEzMzgxMzYx
https://api.github.com/users/bharatr21/orgs
https://api.github.com/users/bharatr21/received_events
https://api.github.com/users/bharatr21/repos
https://api.github.com/users/bharatr21/starred{/owner}{/repo}
https://api.github.com/users/bharatr21/subscriptions
User
https://api.github.com/users/bharatr21
public
MEMBER
Hi @Bharat123rox did you manage to join the different config into one using the IDs ?

Feel free to ping me when you're ready for the next review :) 
2020-12-16T16:07:47Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-746547121
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDc0NjU0NzEyMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/746547121/reactions
2020-12-16T16:07:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/746547121
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
> Hi @Bharat123rox did you manage to join the different config into one using the IDs ?
> 
> Feel free to ping me when you're ready for the next review :) 

Not yet @lhoestq still working on this! Meanwhile please review #1507 where I added the SelQA dataset :)
2020-12-16T16:28:11Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-746583249
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDc0NjU4MzI0OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/746583249/reactions
2020-12-16T16:28:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/746583249
https://avatars.githubusercontent.com/u/13381361?v=4
https://api.github.com/users/bharatr21/events{/privacy}
https://api.github.com/users/bharatr21/followers
https://api.github.com/users/bharatr21/following{/other_user}
https://api.github.com/users/bharatr21/gists{/gist_id}
https://github.com/bharatr21
bharatr21
MDQ6VXNlcjEzMzgxMzYx
https://api.github.com/users/bharatr21/orgs
https://api.github.com/users/bharatr21/received_events
https://api.github.com/users/bharatr21/repos
https://api.github.com/users/bharatr21/starred{/owner}{/repo}
https://api.github.com/users/bharatr21/subscriptions
User
https://api.github.com/users/bharatr21
public
MEMBER
Ok ! Let me review SelQA then :) 
Thanks for your help !
2020-12-16T16:29:21Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-746585237
https://api.github.com/repos/huggingface/datasets/issues/1176
MDEyOklzc3VlQ29tbWVudDc0NjU4NTIzNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/746585237/reactions
2020-12-16T16:29:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/746585237
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Apologies for the very late response. Here is the openpi dataset file with a single file per partition after merging `id_answers, answers.jsonl, question.jsonl , question_metadata.jsonl`

https://github.com/allenai/openpi-dataset/blob/main/data/gold-v1.1/dev.jsonl
2021-07-29T05:57:12Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-888825664
https://api.github.com/repos/huggingface/datasets/issues/1176
IC_kwDODunzps40-mdA
https://api.github.com/repos/huggingface/datasets/issues/comments/888825664/reactions
2021-07-29T05:57:12Z
https://api.github.com/repos/huggingface/datasets/issues/comments/888825664
https://avatars.githubusercontent.com/u/22459345?v=4
https://api.github.com/users/nikett/events{/privacy}
https://api.github.com/users/nikett/followers
https://api.github.com/users/nikett/following{/other_user}
https://api.github.com/users/nikett/gists{/gist_id}
https://github.com/nikett
nikett
MDQ6VXNlcjIyNDU5MzQ1
https://api.github.com/users/nikett/orgs
https://api.github.com/users/nikett/received_events
https://api.github.com/users/nikett/repos
https://api.github.com/users/nikett/starred{/owner}{/repo}
https://api.github.com/users/nikett/subscriptions
User
https://api.github.com/users/nikett
public
MEMBER
Nice thank you @nikett !
2021-07-29T09:50:24Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-888974880
https://api.github.com/repos/huggingface/datasets/issues/1176
IC_kwDODunzps40_K4g
https://api.github.com/repos/huggingface/datasets/issues/comments/888974880/reactions
2021-07-29T09:50:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/888974880
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hi @Bharat123rox , when you get a chance, please feel free to use the dataset from the repo ( [Link](https://github.com/allenai/openpi-dataset/blob/main/data/gold-v1.1/dev.jsonl) ) . Please let me know if any file is missing! Thank you 
2021-09-06T09:19:50Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-913490588
https://api.github.com/repos/huggingface/datasets/issues/1176
IC_kwDODunzps42csKc
https://api.github.com/repos/huggingface/datasets/issues/comments/913490588/reactions
2021-09-06T09:19:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/913490588
https://avatars.githubusercontent.com/u/22459345?v=4
https://api.github.com/users/nikett/events{/privacy}
https://api.github.com/users/nikett/followers
https://api.github.com/users/nikett/following{/other_user}
https://api.github.com/users/nikett/gists{/gist_id}
https://github.com/nikett
nikett
MDQ6VXNlcjIyNDU5MzQ1
https://api.github.com/users/nikett/orgs
https://api.github.com/users/nikett/received_events
https://api.github.com/users/nikett/repos
https://api.github.com/users/nikett/starred{/owner}{/repo}
https://api.github.com/users/nikett/subscriptions
User
https://api.github.com/users/nikett
public
NONE
Hi @Bharat123rox are you working on this? 
2022-03-10T15:51:34Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-1064208017
https://api.github.com/repos/huggingface/datasets/issues/1176
IC_kwDODunzps4_boaR
https://api.github.com/repos/huggingface/datasets/issues/comments/1064208017/reactions
2022-03-10T15:51:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1064208017
https://avatars.githubusercontent.com/u/22459345?v=4
https://api.github.com/users/nikett/events{/privacy}
https://api.github.com/users/nikett/followers
https://api.github.com/users/nikett/following{/other_user}
https://api.github.com/users/nikett/gists{/gist_id}
https://github.com/nikett
nikett
MDQ6VXNlcjIyNDU5MzQ1
https://api.github.com/users/nikett/orgs
https://api.github.com/users/nikett/received_events
https://api.github.com/users/nikett/repos
https://api.github.com/users/nikett/starred{/owner}{/repo}
https://api.github.com/users/nikett/subscriptions
User
https://api.github.com/users/nikett
public
CONTRIBUTOR
@nikett Sorry I'm no longer working on this as I'm out of time for it, please feel free to raise a new PR for this


2022-03-15T11:45:47Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-1067894385
https://api.github.com/repos/huggingface/datasets/issues/1176
IC_kwDODunzps4_psZx
https://api.github.com/repos/huggingface/datasets/issues/comments/1067894385/reactions
2022-03-15T11:45:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1067894385
https://avatars.githubusercontent.com/u/13381361?v=4
https://api.github.com/users/bharatr21/events{/privacy}
https://api.github.com/users/bharatr21/followers
https://api.github.com/users/bharatr21/following{/other_user}
https://api.github.com/users/bharatr21/gists{/gist_id}
https://github.com/bharatr21
bharatr21
MDQ6VXNlcjEzMzgxMzYx
https://api.github.com/users/bharatr21/orgs
https://api.github.com/users/bharatr21/received_events
https://api.github.com/users/bharatr21/repos
https://api.github.com/users/bharatr21/starred{/owner}{/repo}
https://api.github.com/users/bharatr21/subscriptions
User
https://api.github.com/users/bharatr21
public
MEMBER
We are removing the dataset scripts from this GitHub repo and moving them to the Hugging Face Hub: https://huggingface.co/datasets

We would suggest to create this dataset there. Please, feel free to tell us if you need some help.
2022-09-30T14:23:30Z
https://github.com/huggingface/datasets/pull/1176#issuecomment-1263643552
https://api.github.com/repos/huggingface/datasets/issues/1176
IC_kwDODunzps5LUaug
https://api.github.com/repos/huggingface/datasets/issues/comments/1263643552/reactions
2022-09-30T14:23:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1263643552
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
Add the OpenPI Dataset by AI2 (AllenAI)