load_dataset possibly broken for gated datasets?
NONE
@BradleyHsu
2022-11-22T01:22:42Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1322875250
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5O2Xly
https://api.github.com/repos/huggingface/datasets/issues/comments/1322875250/reactions
2022-11-22T01:22:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1322875250
https://avatars.githubusercontent.com/u/32777448?v=4
https://api.github.com/users/KhoomeiK/events{/privacy}
https://api.github.com/users/KhoomeiK/followers
https://api.github.com/users/KhoomeiK/following{/other_user}
https://api.github.com/users/KhoomeiK/gists{/gist_id}
https://github.com/KhoomeiK
KhoomeiK
MDQ6VXNlcjMyNzc3NDQ4
https://api.github.com/users/KhoomeiK/orgs
https://api.github.com/users/KhoomeiK/received_events
https://api.github.com/users/KhoomeiK/repos
https://api.github.com/users/KhoomeiK/starred{/owner}{/repo}
https://api.github.com/users/KhoomeiK/subscriptions
User
https://api.github.com/users/KhoomeiK
public
CONTRIBUTOR
Btw, thanks very much for finding the hub rollback temporary fix and bringing the issue to our attention @KhoomeiK!
2022-11-22T01:44:23Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1322893290
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5O2b_q
https://api.github.com/repos/huggingface/datasets/issues/comments/1322893290/reactions
2022-11-22T01:44:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1322893290
https://avatars.githubusercontent.com/u/20826878?v=4
https://api.github.com/users/TristanThrush/events{/privacy}
https://api.github.com/users/TristanThrush/followers
https://api.github.com/users/TristanThrush/following{/other_user}
https://api.github.com/users/TristanThrush/gists{/gist_id}
https://github.com/TristanThrush
TristanThrush
MDQ6VXNlcjIwODI2ODc4
https://api.github.com/users/TristanThrush/orgs
https://api.github.com/users/TristanThrush/received_events
https://api.github.com/users/TristanThrush/repos
https://api.github.com/users/TristanThrush/starred{/owner}{/repo}
https://api.github.com/users/TristanThrush/subscriptions
User
https://api.github.com/users/TristanThrush
public
NONE
I see the same issue when calling `load_dataset('poloclub/diffusiondb', 'large_random_1k')` with `datasets==2.7.1` and `huggingface-hub=0.11.0`. No issue with `datasets=2.6.1` and `huggingface_hub==0.10.1`.

https://github.com/poloclub/diffusiondb/issues/7
2022-11-24T18:41:35Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1326767092
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5PFNv0
https://api.github.com/repos/huggingface/datasets/issues/comments/1326767092/reactions
2022-11-24T18:48:19Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1326767092
https://avatars.githubusercontent.com/u/15007159?v=4
https://api.github.com/users/xiaohk/events{/privacy}
https://api.github.com/users/xiaohk/followers
https://api.github.com/users/xiaohk/following{/other_user}
https://api.github.com/users/xiaohk/gists{/gist_id}
https://github.com/xiaohk
xiaohk
MDQ6VXNlcjE1MDA3MTU5
https://api.github.com/users/xiaohk/orgs
https://api.github.com/users/xiaohk/received_events
https://api.github.com/users/xiaohk/repos
https://api.github.com/users/xiaohk/starred{/owner}{/repo}
https://api.github.com/users/xiaohk/subscriptions
User
https://api.github.com/users/xiaohk
public
NONE
I fixed my issue by specifying `repo_type` in `hf_hub_url()`. https://github.com/poloclub/diffusiondb/commit/9eb91c79aaca98b0515a0ce45778b8af65b84652

I opened a PR on the Winoground's repo: https://huggingface.co/datasets/facebook/winoground/discussions/2
2022-11-24T19:51:11Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1326801563
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5PFWKb
https://api.github.com/repos/huggingface/datasets/issues/comments/1326801563/reactions
2022-11-24T19:51:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1326801563
https://avatars.githubusercontent.com/u/15007159?v=4
https://api.github.com/users/xiaohk/events{/privacy}
https://api.github.com/users/xiaohk/followers
https://api.github.com/users/xiaohk/following{/other_user}
https://api.github.com/users/xiaohk/gists{/gist_id}
https://github.com/xiaohk
xiaohk
MDQ6VXNlcjE1MDA3MTU5
https://api.github.com/users/xiaohk/orgs
https://api.github.com/users/xiaohk/received_events
https://api.github.com/users/xiaohk/repos
https://api.github.com/users/xiaohk/starred{/owner}{/repo}
https://api.github.com/users/xiaohk/subscriptions
User
https://api.github.com/users/xiaohk
public
COLLABORATOR
This is a bug in the script, indeed. The most robust fix is to use a relative path instead of `hf_hub_url`, which does not depend on `huggingface_hub`'s version 🙂. I've opened a PR here: https://huggingface.co/datasets/facebook/winoground/discussions/3.
2022-11-25T14:14:03Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1327523319
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5PIGX3
https://api.github.com/repos/huggingface/datasets/issues/comments/1327523319/reactions
2022-11-25T14:14:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1327523319
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
CONTRIBUTOR
Awesome, big thanks to both @xiaohk and @mariosasko!
2022-11-28T02:50:42Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1328459459
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5PLq7D
https://api.github.com/repos/huggingface/datasets/issues/comments/1328459459/reactions
2022-11-28T02:50:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1328459459
https://avatars.githubusercontent.com/u/20826878?v=4
https://api.github.com/users/TristanThrush/events{/privacy}
https://api.github.com/users/TristanThrush/followers
https://api.github.com/users/TristanThrush/following{/other_user}
https://api.github.com/users/TristanThrush/gists{/gist_id}
https://github.com/TristanThrush
TristanThrush
MDQ6VXNlcjIwODI2ODc4
https://api.github.com/users/TristanThrush/orgs
https://api.github.com/users/TristanThrush/received_events
https://api.github.com/users/TristanThrush/repos
https://api.github.com/users/TristanThrush/starred{/owner}{/repo}
https://api.github.com/users/TristanThrush/subscriptions
User
https://api.github.com/users/TristanThrush
public
NONE
so, if i reproduce the bug, what should i do ? with huggingface_hub0.13.3  dataset2.6.1
2023-04-04T09:59:09Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1495685438
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5ZJlk-
https://api.github.com/repos/huggingface/datasets/issues/comments/1495685438/reactions
2023-04-04T09:59:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1495685438
https://avatars.githubusercontent.com/u/109226809?v=4
https://api.github.com/users/TobiasWYH/events{/privacy}
https://api.github.com/users/TobiasWYH/followers
https://api.github.com/users/TobiasWYH/following{/other_user}
https://api.github.com/users/TobiasWYH/gists{/gist_id}
https://github.com/TobiasWYH
TobiasWYH
U_kgDOBoKrOQ
https://api.github.com/users/TobiasWYH/orgs
https://api.github.com/users/TobiasWYH/received_events
https://api.github.com/users/TobiasWYH/repos
https://api.github.com/users/TobiasWYH/starred{/owner}{/repo}
https://api.github.com/users/TobiasWYH/subscriptions
User
https://api.github.com/users/TobiasWYH
public
NONE
huggingface_hub.utils._validators.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name':

    tokenizer = AutoTokenizer.from_pretrained(ARGS.model_path, trust_remote_code=True)

Please handle automatically for local path and repo name inside, otherwise users always get confused about this
2023-05-05T03:09:02Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1535642921
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5biA0p
https://api.github.com/repos/huggingface/datasets/issues/comments/1535642921/reactions
2023-05-05T03:09:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1535642921
https://avatars.githubusercontent.com/u/21303438?v=4
https://api.github.com/users/lucasjinreal/events{/privacy}
https://api.github.com/users/lucasjinreal/followers
https://api.github.com/users/lucasjinreal/following{/other_user}
https://api.github.com/users/lucasjinreal/gists{/gist_id}
https://github.com/lucasjinreal
lucasjinreal
MDQ6VXNlcjIxMzAzNDM4
https://api.github.com/users/lucasjinreal/orgs
https://api.github.com/users/lucasjinreal/received_events
https://api.github.com/users/lucasjinreal/repos
https://api.github.com/users/lucasjinreal/starred{/owner}{/repo}
https://api.github.com/users/lucasjinreal/subscriptions
User
https://api.github.com/users/lucasjinreal
public
NONE
I think I'm also hitting this error, trying to load a model from a local path.
2023-05-27T00:06:14Z
https://github.com/huggingface/datasets/issues/5274#issuecomment-1565089364
https://api.github.com/repos/huggingface/datasets/issues/5274
IC_kwDODunzps5dSV5U
https://api.github.com/repos/huggingface/datasets/issues/comments/1565089364/reactions
2023-05-27T00:06:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1565089364
https://avatars.githubusercontent.com/u/184322?v=4
https://api.github.com/users/NikolaBorisov/events{/privacy}
https://api.github.com/users/NikolaBorisov/followers
https://api.github.com/users/NikolaBorisov/following{/other_user}
https://api.github.com/users/NikolaBorisov/gists{/gist_id}
https://github.com/NikolaBorisov
NikolaBorisov
MDQ6VXNlcjE4NDMyMg==
https://api.github.com/users/NikolaBorisov/orgs
https://api.github.com/users/NikolaBorisov/received_events
https://api.github.com/users/NikolaBorisov/repos
https://api.github.com/users/NikolaBorisov/starred{/owner}{/repo}
https://api.github.com/users/NikolaBorisov/subscriptions
User
https://api.github.com/users/NikolaBorisov
public
### Describe the bug

When trying to download the [winoground dataset](https://huggingface.co/datasets/facebook/winoground), I get this error unless I roll back the version of huggingface-hub:

```
[/usr/local/lib/python3.7/dist-packages/huggingface_hub/utils/_validators.py](https://localhost:8080/#) in validate_repo_id(repo_id)
    165     if repo_id.count("/") > 1:
    166         raise HFValidationError(
--> 167             "Repo id must be in the form 'repo_name' or 'namespace/repo_name':"
    168             f" '{repo_id}'. Use `repo_type` argument if needed."
    169         )

HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name': 'datasets/facebook/winoground'. Use `repo_type` argument if needed
```

### Steps to reproduce the bug

Install requirements:

```
pip install transformers
pip install datasets
# It works if you uncomment the following line, rolling back huggingface hub:
# pip install huggingface-hub==0.10.1
```

Then:

```
from datasets import load_dataset
auth_token = ""  # Replace with an auth token, which you can get from your huggingface account: Profile -> Settings -> Access Tokens -> New Token
winoground = load_dataset("facebook/winoground", use_auth_token=auth_token)["test"]
```





### Expected behavior

Downloading of the datset

### Environment info

Just a google colab; see here: https://colab.research.google.com/drive/15wwOSte2CjTazdnCWYUm2VPlFbk2NGc0?usp=sharing