addition of py_ast
MEMBER
Hi @reshinthadithyan !

As mentioned on the Slack, it would be better in this case to parse the file lines into the following feature structure:
```python
"ast": datasets.Sequence(
    {
        "type": datasets.Value("string"),
        "value": datasets.Value("string"),
        "children": datasets.Sequence(datasets.Value("int32")),
    },
)
```

Here are a few more things to fix before we can move forward:
- the class name needs to be the CamelCase equivalent of the script name, so here it will have to be `PyAst`
- the `README.md` needs to have the tags at the top
- The homepage/info list at the top should be in the same format as the template (added a suggestion)
- You should add the dataset tags and field description to the README as described here: https://github.com/huggingface/datasets/blob/master/ADD_NEW_DATASET.md#tag-the-dataset-and-write-the-dataset-card

Good luck, let us know if you need any help!
2020-12-06T14:57:14Z
https://github.com/huggingface/datasets/pull/1195#issuecomment-739514206
https://api.github.com/repos/huggingface/datasets/issues/1195
MDEyOklzc3VlQ29tbWVudDczOTUxNDIwNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/739514206/reactions
2020-12-06T14:57:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739514206
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
CONTRIBUTOR
Hello @yjernite, changes have been made as we talked. Hope this would suffice. Thanks. Feel free to point out any room to improvement.
2020-12-06T17:35:16Z
https://github.com/huggingface/datasets/pull/1195#issuecomment-739535971
https://api.github.com/repos/huggingface/datasets/issues/1195
MDEyOklzc3VlQ29tbWVudDczOTUzNTk3MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/739535971/reactions
2020-12-06T17:35:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739535971
https://avatars.githubusercontent.com/u/36307201?v=4
https://api.github.com/users/reshinthadithyan/events{/privacy}
https://api.github.com/users/reshinthadithyan/followers
https://api.github.com/users/reshinthadithyan/following{/other_user}
https://api.github.com/users/reshinthadithyan/gists{/gist_id}
https://github.com/reshinthadithyan
reshinthadithyan
MDQ6VXNlcjM2MzA3MjAx
https://api.github.com/users/reshinthadithyan/orgs
https://api.github.com/users/reshinthadithyan/received_events
https://api.github.com/users/reshinthadithyan/repos
https://api.github.com/users/reshinthadithyan/starred{/owner}{/repo}
https://api.github.com/users/reshinthadithyan/subscriptions
User
https://api.github.com/users/reshinthadithyan
public
MEMBER
Good progress! Here's what still needs to be done:
- first, you need to rebase to master for the tests to pass :)
- the information in your `Data Fields` paragraph should go into `Data Instances`. Data fields should describe the fields one by one, as in e.g. https://github.com/huggingface/datasets/tree/master/datasets/eli5#data-fields
- you still need to add the YAML tags obtained with the tagging app

Should be good to go after that!
2020-12-06T18:35:21Z
https://github.com/huggingface/datasets/pull/1195#issuecomment-739543876
https://api.github.com/repos/huggingface/datasets/issues/1195
MDEyOklzc3VlQ29tbWVudDczOTU0Mzg3Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/739543876/reactions
2020-12-06T18:35:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739543876
https://avatars.githubusercontent.com/u/10469459?v=4
https://api.github.com/users/yjernite/events{/privacy}
https://api.github.com/users/yjernite/followers
https://api.github.com/users/yjernite/following{/other_user}
https://api.github.com/users/yjernite/gists{/gist_id}
https://github.com/yjernite
yjernite
MDQ6VXNlcjEwNDY5NDU5
https://api.github.com/users/yjernite/orgs
https://api.github.com/users/yjernite/received_events
https://api.github.com/users/yjernite/repos
https://api.github.com/users/yjernite/starred{/owner}{/repo}
https://api.github.com/users/yjernite/subscriptions
User
https://api.github.com/users/yjernite
public
CONTRIBUTOR
Hello @yjernite, changes as talked are being done.
2020-12-07T06:29:38Z
https://github.com/huggingface/datasets/pull/1195#issuecomment-739699744
https://api.github.com/repos/huggingface/datasets/issues/1195
MDEyOklzc3VlQ29tbWVudDczOTY5OTc0NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/739699744/reactions
2020-12-07T06:29:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739699744
https://avatars.githubusercontent.com/u/36307201?v=4
https://api.github.com/users/reshinthadithyan/events{/privacy}
https://api.github.com/users/reshinthadithyan/followers
https://api.github.com/users/reshinthadithyan/following{/other_user}
https://api.github.com/users/reshinthadithyan/gists{/gist_id}
https://github.com/reshinthadithyan
reshinthadithyan
MDQ6VXNlcjM2MzA3MjAx
https://api.github.com/users/reshinthadithyan/orgs
https://api.github.com/users/reshinthadithyan/received_events
https://api.github.com/users/reshinthadithyan/repos
https://api.github.com/users/reshinthadithyan/starred{/owner}{/repo}
https://api.github.com/users/reshinthadithyan/subscriptions
User
https://api.github.com/users/reshinthadithyan
public
MEMBER
Looks like this PR includes changes about many other files than the ones for py_ast

Could you create another branch and another PR please ?
2020-12-07T15:15:46Z
https://github.com/huggingface/datasets/pull/1195#issuecomment-739981255
https://api.github.com/repos/huggingface/datasets/issues/1195
MDEyOklzc3VlQ29tbWVudDczOTk4MTI1NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/739981255/reactions
2020-12-07T15:15:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/739981255
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
The dataset consists of parsed Parsed ASTs that were used to train and evaluate the DeepSyn tool. 
The Python programs are collected from GitHub repositories
by removing duplicate files, removing project forks (copy of another existing repository)
,keeping only programs that parse and have at most 30'000 nodes in the AST and 
we aim to remove obfuscated files