[Feature] More dataset outputs
MEMBER
Yes!
- pandas will be a one-liner in `arrow_dataset`: https://arrow.apache.org/docs/python/generated/pyarrow.Table.html#pyarrow.Table.to_pandas
- for Spark I have no idea. let's investigate that at some point
2020-04-15T21:22:41Z
https://github.com/huggingface/datasets/issues/3#issuecomment-614287033
https://api.github.com/repos/huggingface/datasets/issues/3
MDEyOklzc3VlQ29tbWVudDYxNDI4NzAzMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/614287033/reactions
2020-04-15T21:22:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/614287033
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
CONTRIBUTOR
For Spark it looks to be pretty straightforward as well https://spark.apache.org/docs/latest/sql-pyspark-pandas-with-arrow.html but looks to be having a dependency to Spark is necessary, then nevermind we can skip it
2020-04-16T10:07:22Z
https://github.com/huggingface/datasets/issues/3#issuecomment-614550627
https://api.github.com/repos/huggingface/datasets/issues/3
MDEyOklzc3VlQ29tbWVudDYxNDU1MDYyNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/614550627/reactions
2020-04-16T10:09:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/614550627
https://avatars.githubusercontent.com/u/959590?v=4
https://api.github.com/users/jplu/events{/privacy}
https://api.github.com/users/jplu/followers
https://api.github.com/users/jplu/following{/other_user}
https://api.github.com/users/jplu/gists{/gist_id}
https://github.com/jplu
jplu
MDQ6VXNlcjk1OTU5MA==
https://api.github.com/users/jplu/orgs
https://api.github.com/users/jplu/received_events
https://api.github.com/users/jplu/repos
https://api.github.com/users/jplu/starred{/owner}{/repo}
https://api.github.com/users/jplu/subscriptions
User
https://api.github.com/users/jplu
public
CONTRIBUTOR
Now Pandas is available.
2020-05-04T06:12:27Z
https://github.com/huggingface/datasets/issues/3#issuecomment-623276695
https://api.github.com/repos/huggingface/datasets/issues/3
MDEyOklzc3VlQ29tbWVudDYyMzI3NjY5NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/623276695/reactions
2020-05-04T06:12:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/623276695
https://avatars.githubusercontent.com/u/959590?v=4
https://api.github.com/users/jplu/events{/privacy}
https://api.github.com/users/jplu/followers
https://api.github.com/users/jplu/following{/other_user}
https://api.github.com/users/jplu/gists{/gist_id}
https://github.com/jplu
jplu
MDQ6VXNlcjk1OTU5MA==
https://api.github.com/users/jplu/orgs
https://api.github.com/users/jplu/received_events
https://api.github.com/users/jplu/repos
https://api.github.com/users/jplu/starred{/owner}{/repo}
https://api.github.com/users/jplu/subscriptions
User
https://api.github.com/users/jplu
public
Add the following dataset outputs:

- Spark
- Pandas