Adding support for netCDF (*.nc) files
NONE
Related to #3113 
2023-12-27T20:44:46Z
https://github.com/huggingface/datasets/issues/6537#issuecomment-1870615776
https://api.github.com/repos/huggingface/datasets/issues/6537
IC_kwDODunzps5vf1Tg
https://api.github.com/repos/huggingface/datasets/issues/comments/1870615776/reactions
2023-12-27T20:44:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1870615776
https://avatars.githubusercontent.com/u/12627125?v=4
https://api.github.com/users/shermansiu/events{/privacy}
https://api.github.com/users/shermansiu/followers
https://api.github.com/users/shermansiu/following{/other_user}
https://api.github.com/users/shermansiu/gists{/gist_id}
https://github.com/shermansiu
shermansiu
MDQ6VXNlcjEyNjI3MTI1
https://api.github.com/users/shermansiu/orgs
https://api.github.com/users/shermansiu/received_events
https://api.github.com/users/shermansiu/repos
https://api.github.com/users/shermansiu/starred{/owner}{/repo}
https://api.github.com/users/shermansiu/subscriptions
User
https://api.github.com/users/shermansiu
public
NONE
Conceptually, we can use xarray to load the netCDF file, then xarray -> pandas -> pyarrow.
2023-12-27T20:45:26Z
https://github.com/huggingface/datasets/issues/6537#issuecomment-1870616122
https://api.github.com/repos/huggingface/datasets/issues/6537
IC_kwDODunzps5vf1Y6
https://api.github.com/repos/huggingface/datasets/issues/comments/1870616122/reactions
2023-12-27T20:45:26Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1870616122
https://avatars.githubusercontent.com/u/12627125?v=4
https://api.github.com/users/shermansiu/events{/privacy}
https://api.github.com/users/shermansiu/followers
https://api.github.com/users/shermansiu/following{/other_user}
https://api.github.com/users/shermansiu/gists{/gist_id}
https://github.com/shermansiu
shermansiu
MDQ6VXNlcjEyNjI3MTI1
https://api.github.com/users/shermansiu/orgs
https://api.github.com/users/shermansiu/received_events
https://api.github.com/users/shermansiu/repos
https://api.github.com/users/shermansiu/starred{/owner}{/repo}
https://api.github.com/users/shermansiu/subscriptions
User
https://api.github.com/users/shermansiu
public
NONE
I'd still need to verify that such a conversion would be lossless, especially for multi-dimensional data.
2023-12-27T20:46:35Z
https://github.com/huggingface/datasets/issues/6537#issuecomment-1870616724
https://api.github.com/repos/huggingface/datasets/issues/6537
IC_kwDODunzps5vf1iU
https://api.github.com/repos/huggingface/datasets/issues/comments/1870616724/reactions
2023-12-27T20:46:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1870616724
https://avatars.githubusercontent.com/u/12627125?v=4
https://api.github.com/users/shermansiu/events{/privacy}
https://api.github.com/users/shermansiu/followers
https://api.github.com/users/shermansiu/following{/other_user}
https://api.github.com/users/shermansiu/gists{/gist_id}
https://github.com/shermansiu
shermansiu
MDQ6VXNlcjEyNjI3MTI1
https://api.github.com/users/shermansiu/orgs
https://api.github.com/users/shermansiu/received_events
https://api.github.com/users/shermansiu/repos
https://api.github.com/users/shermansiu/starred{/owner}{/repo}
https://api.github.com/users/shermansiu/subscriptions
User
https://api.github.com/users/shermansiu
public
### Feature request

netCDF (*.nc) is a file format for storing multidimensional scientific data, which is used by packages like `xarray` (labelled multi-dimensional arrays in Python). It would be nice to have native support for netCDF in `datasets`.

### Motivation

When uploading *.nc files onto Huggingface Hub through the `datasets` API, I would like to be able to preview the dataset without converting it to another format.

### Your contribution

I can submit a PR, provided I have the time.