How to get the original dataset name with username?
MEMBER
Hi ! why not pass the dataset id to Ray and let it check the parquet files ? Or pass the parquet files lists directly ?
2025-01-09T10:35:59Z
https://github.com/huggingface/datasets/issues/7311#issuecomment-2579774631
https://api.github.com/repos/huggingface/datasets/issues/7311
IC_kwDODunzps6ZxDyn
https://api.github.com/repos/huggingface/datasets/issues/comments/2579774631/reactions
2025-01-09T10:35:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2579774631
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
I'm not sure why ray design an API like this to accept a `Dataset` object, so they need to verify the `Dataset` is the original one and use the `DatasetInfo` to query the huggingface hub. I'll advise the ray data team to use dataset id instead of dataset for the `HuggingFaceDatasource` API.
2025-01-09T10:48:00Z
https://github.com/huggingface/datasets/issues/7311#issuecomment-2579816563
https://api.github.com/repos/huggingface/datasets/issues/7311
IC_kwDODunzps6ZxOBz
https://api.github.com/repos/huggingface/datasets/issues/comments/2579816563/reactions
2025-01-09T10:48:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2579816563
https://avatars.githubusercontent.com/u/11533479?v=4
https://api.github.com/users/npuichigo/events{/privacy}
https://api.github.com/users/npuichigo/followers
https://api.github.com/users/npuichigo/following{/other_user}
https://api.github.com/users/npuichigo/gists{/gist_id}
https://github.com/npuichigo
npuichigo
MDQ6VXNlcjExNTMzNDc5
https://api.github.com/users/npuichigo/orgs
https://api.github.com/users/npuichigo/received_events
https://api.github.com/users/npuichigo/repos
https://api.github.com/users/npuichigo/starred{/owner}{/repo}
https://api.github.com/users/npuichigo/subscriptions
User
https://api.github.com/users/npuichigo
public
### Feature request

The issue is related to ray data https://github.com/ray-project/ray/issues/49008 which it requires to check if the dataset is the original one just after `load_dataset` and parquet files are already available on hf hub.

The solution used now is to get the dataset name, config and split, then `load_dataset` again and check the fingerprint. But it's unable to get the correct dataset name if it contains username. So how to get the dataset name with username prefix, or is there another way to query if a dataset is the original one with parquet available?

@lhoestq 

### Motivation

https://github.com/ray-project/ray/issues/49008

### Your contribution

Would like to fix that.