Remove get_inferred_type from ArrowWriter write_batch
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_6781). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
2024-04-05T16:11:37Z
https://github.com/huggingface/datasets/pull/6781#issuecomment-2040192084
https://api.github.com/repos/huggingface/datasets/issues/6781
IC_kwDODunzps55mtxU
https://api.github.com/repos/huggingface/datasets/issues/comments/2040192084/reactions
2024-04-05T16:11:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2040192084
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
Close in favor of #6786.
2024-04-09T07:49:11Z
https://github.com/huggingface/datasets/pull/6781#issuecomment-2044363535
https://api.github.com/repos/huggingface/datasets/issues/6781
IC_kwDODunzps552oMP
https://api.github.com/repos/huggingface/datasets/issues/comments/2044363535/reactions
2024-04-09T07:49:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2044363535
https://avatars.githubusercontent.com/u/37351874?v=4
https://api.github.com/users/Modexus/events{/privacy}
https://api.github.com/users/Modexus/followers
https://api.github.com/users/Modexus/following{/other_user}
https://api.github.com/users/Modexus/gists{/gist_id}
https://github.com/Modexus
Modexus
MDQ6VXNlcjM3MzUxODc0
https://api.github.com/users/Modexus/orgs
https://api.github.com/users/Modexus/received_events
https://api.github.com/users/Modexus/repos
https://api.github.com/users/Modexus/starred{/owner}{/repo}
https://api.github.com/users/Modexus/subscriptions
User
https://api.github.com/users/Modexus
public
Inferring the type seems to be unnecessary given that the pyarrow array has already been created.
Because pyarrow array creation is sometimes extremely slow this doubles the time write_batch takes.