would huggingface like publish cpp binding for datasets package ?
MEMBER
Hi ! Can you share more information about your use case ? How could it help you to have cpp bindings versus using the python libraries ?
2022-09-26T09:33:46Z
https://github.com/huggingface/datasets/issues/5013#issuecomment-1257760782
https://api.github.com/repos/huggingface/datasets/issues/5013
IC_kwDODunzps5K9-gO
https://api.github.com/repos/huggingface/datasets/issues/comments/1257760782/reactions
2022-09-26T09:33:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1257760782
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
> Hi ! Can you share more information about your use case ? How could it help you to have cpp bindings versus using the python libraries ?

for example ,the huggingface  load_model() and load_dataset()  can  execute in cpp env
2022-09-26T10:06:53Z
https://github.com/huggingface/datasets/issues/5013#issuecomment-1257800333
https://api.github.com/repos/huggingface/datasets/issues/5013
IC_kwDODunzps5K-IKN
https://api.github.com/repos/huggingface/datasets/issues/comments/1257800333/reactions
2022-09-26T10:06:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1257800333
https://avatars.githubusercontent.com/u/6143404?v=4
https://api.github.com/users/mullerhai/events{/privacy}
https://api.github.com/users/mullerhai/followers
https://api.github.com/users/mullerhai/following{/other_user}
https://api.github.com/users/mullerhai/gists{/gist_id}
https://github.com/mullerhai
mullerhai
MDQ6VXNlcjYxNDM0MDQ=
https://api.github.com/users/mullerhai/orgs
https://api.github.com/users/mullerhai/received_events
https://api.github.com/users/mullerhai/repos
https://api.github.com/users/mullerhai/starred{/owner}{/repo}
https://api.github.com/users/mullerhai/subscriptions
User
https://api.github.com/users/mullerhai
public
MEMBER
If it's a viable option for you, you can check [tch-rs](https://github.com/LaurentMazare/tch-rs) to load models in Rust. Regarding datasets, you can first download them in python and then use Arrow C++ or Rust to load them
2022-09-26T12:08:52Z
https://github.com/huggingface/datasets/issues/5013#issuecomment-1257934672
https://api.github.com/repos/huggingface/datasets/issues/5013
IC_kwDODunzps5K-o9Q
https://api.github.com/repos/huggingface/datasets/issues/comments/1257934672/reactions
2022-09-26T12:08:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1257934672
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
COLLABORATOR
If you are more adventurous, another option is to embed python calls inside c++ e.g. with `pybind11`.
2022-09-26T16:47:45Z
https://github.com/huggingface/datasets/issues/5013#issuecomment-1258334816
https://api.github.com/repos/huggingface/datasets/issues/5013
IC_kwDODunzps5LAKpg
https://api.github.com/repos/huggingface/datasets/issues/comments/1258334816/reactions
2022-09-26T16:47:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1258334816
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
> pybind11

I think it is not the best solution
2022-09-27T03:40:30Z
https://github.com/huggingface/datasets/issues/5013#issuecomment-1258927434
https://api.github.com/repos/huggingface/datasets/issues/5013
IC_kwDODunzps5LCbVK
https://api.github.com/repos/huggingface/datasets/issues/comments/1258927434/reactions
2022-09-27T03:40:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1258927434
https://avatars.githubusercontent.com/u/6143404?v=4
https://api.github.com/users/mullerhai/events{/privacy}
https://api.github.com/users/mullerhai/followers
https://api.github.com/users/mullerhai/following{/other_user}
https://api.github.com/users/mullerhai/gists{/gist_id}
https://github.com/mullerhai
mullerhai
MDQ6VXNlcjYxNDM0MDQ=
https://api.github.com/users/mullerhai/orgs
https://api.github.com/users/mullerhai/received_events
https://api.github.com/users/mullerhai/repos
https://api.github.com/users/mullerhai/starred{/owner}{/repo}
https://api.github.com/users/mullerhai/subscriptions
User
https://api.github.com/users/mullerhai
public
HI:
I use cpp env libtorch, I like use hugggingface ,but huggingface not cpp binding, would you like publish cpp binding for it.
thanks