Support skipping Parquet to Arrow conversion when using Beam
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_4509). All of your documentation changes will be reflected on that endpoint.
2022-06-16T08:32:25Z
https://github.com/huggingface/datasets/pull/4509#issuecomment-1157385879
https://api.github.com/repos/huggingface/datasets/issues/4509
IC_kwDODunzps5E_E6X
https://api.github.com/repos/huggingface/datasets/issues/comments/1157385879/reactions
2022-06-16T08:32:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1157385879
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
When #4724 is merged, we can just pass `file_format="parquet"` to `download_and_prepare` and it will output parquet fiels without converting to arrow
2022-07-27T16:03:19Z
https://github.com/huggingface/datasets/pull/4509#issuecomment-1196952882
https://api.github.com/repos/huggingface/datasets/issues/4509
IC_kwDODunzps5HWA0y
https://api.github.com/repos/huggingface/datasets/issues/comments/1196952882/reactions
2022-07-27T16:03:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1196952882
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
I think we can close this one
2022-11-07T16:22:41Z
https://github.com/huggingface/datasets/pull/4509#issuecomment-1305858862
https://api.github.com/repos/huggingface/datasets/issues/4509
IC_kwDODunzps5N1dMu
https://api.github.com/repos/huggingface/datasets/issues/comments/1305858862/reactions
2022-11-07T16:22:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1305858862
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public