Introduce pdf support (#7318)
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_7325). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
2024-12-17T13:45:13Z
https://github.com/huggingface/datasets/pull/7325#issuecomment-2548502861
https://api.github.com/repos/huggingface/datasets/issues/7325
IC_kwDODunzps6X5xFN
https://api.github.com/repos/huggingface/datasets/issues/comments/2548502861/reactions
2024-12-17T13:45:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2548502861
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
Hi @AndreaFrancis and @lhoestq ! Thanks for looking at the code and for all the changes and suggestions. I have worked on all your suggestions. I need to work a bit more on the tests, but I created a first version and uploaded a simple pdf to use for testing. The pdf has a couple of pages some of which have images, figures, and tables (this is exactly the pdfs for which I think keeping the pdf format is very interesting because they have multiple types of content). Will try to finish the tests as soon as possible.
2024-12-19T17:22:49Z
https://github.com/huggingface/datasets/pull/7325#issuecomment-2555242098
https://api.github.com/repos/huggingface/datasets/issues/7325
IC_kwDODunzps6YTeZy
https://api.github.com/repos/huggingface/datasets/issues/comments/2555242098/reactions
2024-12-19T17:22:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2555242098
https://avatars.githubusercontent.com/u/4812761?v=4
https://api.github.com/users/yabramuvdi/events{/privacy}
https://api.github.com/users/yabramuvdi/followers
https://api.github.com/users/yabramuvdi/following{/other_user}
https://api.github.com/users/yabramuvdi/gists{/gist_id}
https://github.com/yabramuvdi
yabramuvdi
MDQ6VXNlcjQ4MTI3NjE=
https://api.github.com/users/yabramuvdi/orgs
https://api.github.com/users/yabramuvdi/received_events
https://api.github.com/users/yabramuvdi/repos
https://api.github.com/users/yabramuvdi/starred{/owner}{/repo}
https://api.github.com/users/yabramuvdi/subscriptions
User
https://api.github.com/users/yabramuvdi
public
MEMBER
(I updated the CI a bit, I took the liberty to update your branch and re-run it on your PR @yabramuvdi)
2025-01-03T15:36:04Z
https://github.com/huggingface/datasets/pull/7325#issuecomment-2569419783
https://api.github.com/repos/huggingface/datasets/issues/7325
IC_kwDODunzps6ZJjwH
https://api.github.com/repos/huggingface/datasets/issues/comments/2569419783/reactions
2025-01-03T15:36:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2569419783
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
First implementation of the Pdf feature to support pdfs (#7318) . Using [pdfplumber](https://github.com/jsvine/pdfplumber?tab=readme-ov-file#python-library) as the default library to work with pdfs. 
@lhoestq and @AndreaFrancis 