HDF5 support
NONE
A few to-dos which I think can be left for future PRs (which I am happy to do/help with -- just this one is already huge 😄 ):
- [Enum types](https://docs.h5py.org/en/stable/special.html#enumerated-types)
- HDF5 [io](https://github.com/huggingface/datasets/tree/main/src/datasets/io)
- [dataset-viewer](https://github.com/huggingface/dataset-viewer) support (not sure if changes are needed with the way it is written now)
2025-07-23T02:11:02Z
https://github.com/huggingface/datasets/pull/7690#issuecomment-3105391677
https://api.github.com/repos/huggingface/datasets/issues/7690
IC_kwDODunzps65GIQ9
https://api.github.com/repos/huggingface/datasets/issues/comments/3105391677/reactions
2025-07-23T02:54:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3105391677
https://avatars.githubusercontent.com/u/17013474?v=4
https://api.github.com/users/klamike/events{/privacy}
https://api.github.com/users/klamike/followers
https://api.github.com/users/klamike/following{/other_user}
https://api.github.com/users/klamike/gists{/gist_id}
https://github.com/klamike
klamike
MDQ6VXNlcjE3MDEzNDc0
https://api.github.com/users/klamike/orgs
https://api.github.com/users/klamike/received_events
https://api.github.com/users/klamike/repos
https://api.github.com/users/klamike/starred{/owner}{/repo}
https://api.github.com/users/klamike/subscriptions
User
https://api.github.com/users/klamike
public
NONE
@lhoestq any interest in merging this? Let me know if I can do anything to make reviewing it easier!
2025-07-25T15:22:21Z
https://github.com/huggingface/datasets/pull/7690#issuecomment-3118570910
https://api.github.com/repos/huggingface/datasets/issues/7690
IC_kwDODunzps654Z2e
https://api.github.com/repos/huggingface/datasets/issues/comments/3118570910/reactions
2025-07-25T15:22:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3118570910
https://avatars.githubusercontent.com/u/17013474?v=4
https://api.github.com/users/klamike/events{/privacy}
https://api.github.com/users/klamike/followers
https://api.github.com/users/klamike/following{/other_user}
https://api.github.com/users/klamike/gists{/gist_id}
https://github.com/klamike
klamike
MDQ6VXNlcjE3MDEzNDc0
https://api.github.com/users/klamike/orgs
https://api.github.com/users/klamike/received_events
https://api.github.com/users/klamike/repos
https://api.github.com/users/klamike/starred{/owner}{/repo}
https://api.github.com/users/klamike/subscriptions
User
https://api.github.com/users/klamike
public
This PR adds support for tabular HDF5 file(s) by converting each row to an Arrow table. It supports columns with the usual dtypes including up to 5-dimensional arrays as well as support for complex/compound types by splitting them into several columns. All datasets within the HDF5 file should have rows on the first dimension (groups/subgroups are still allowed). Closes #3113.

Replaces #7625 which only supports a relatively small subset of HDF5.