Add OpenAI's HumanEval dataset
MEMBER
I just fixed the class name, and added `[More Information Needed]` in empty sections in case people want to complete the dataset card :)
2021-09-16T14:37:53Z
https://github.com/huggingface/datasets/pull/2897#issuecomment-920961421
https://api.github.com/repos/huggingface/datasets/issues/2897
IC_kwDODunzps425MGN
https://api.github.com/repos/huggingface/datasets/issues/comments/920961421/reactions
2021-09-16T14:37:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/920961421
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
This PR adds OpenAI's [HumanEval](https://github.com/openai/human-eval) dataset. The dataset consists of 164 handcrafted programming problems with solutions and unittests to verify solution. This dataset is useful to evaluate code generation models.