`ImportError`: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (.../huggingface_hub/utils/__init__.py)
NONE
@Wauplin Do you happen to know what's up?
2024-01-06T02:40:32Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1879506169
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps5wBvz5
https://api.github.com/repos/huggingface/datasets/issues/comments/1879506169/reactions
2024-01-06T02:40:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1879506169
https://avatars.githubusercontent.com/u/79070834?v=4
https://api.github.com/users/wasertech/events{/privacy}
https://api.github.com/users/wasertech/followers
https://api.github.com/users/wasertech/following{/other_user}
https://api.github.com/users/wasertech/gists{/gist_id}
https://github.com/wasertech
wasertech
MDQ6VXNlcjc5MDcwODM0
https://api.github.com/users/wasertech/orgs
https://api.github.com/users/wasertech/received_events
https://api.github.com/users/wasertech/repos
https://api.github.com/users/wasertech/starred{/owner}{/repo}
https://api.github.com/users/wasertech/subscriptions
User
https://api.github.com/users/wasertech
public
NONE
<del>Installing `datasets` from `main` did the trick so I guess it will be fixed in the next release.

NVM https://github.com/huggingface/datasets/blob/d26abadce0b884db32382b92422d8a6aa997d40a/src/datasets/utils/info_utils.py#L5
2024-01-06T03:49:08Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1879525791
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps5wB0mf
https://api.github.com/repos/huggingface/datasets/issues/comments/1879525791/reactions
2024-01-06T03:51:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1879525791
https://avatars.githubusercontent.com/u/79070834?v=4
https://api.github.com/users/wasertech/events{/privacy}
https://api.github.com/users/wasertech/followers
https://api.github.com/users/wasertech/following{/other_user}
https://api.github.com/users/wasertech/gists{/gist_id}
https://github.com/wasertech
wasertech
MDQ6VXNlcjc5MDcwODM0
https://api.github.com/users/wasertech/orgs
https://api.github.com/users/wasertech/received_events
https://api.github.com/users/wasertech/repos
https://api.github.com/users/wasertech/starred{/owner}{/repo}
https://api.github.com/users/wasertech/subscriptions
User
https://api.github.com/users/wasertech
public
CONTRIBUTOR
@wasertech upgrading `huggingface_hub` to a newer version should fix your issue. Latest version is 0.20.2. 
2024-01-06T15:24:58Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1879728035
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps5wCl-j
https://api.github.com/repos/huggingface/datasets/issues/comments/1879728035/reactions
2024-01-06T15:24:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1879728035
https://avatars.githubusercontent.com/u/11801849?v=4
https://api.github.com/users/Wauplin/events{/privacy}
https://api.github.com/users/Wauplin/followers
https://api.github.com/users/Wauplin/following{/other_user}
https://api.github.com/users/Wauplin/gists{/gist_id}
https://github.com/Wauplin
Wauplin
MDQ6VXNlcjExODAxODQ5
https://api.github.com/users/Wauplin/orgs
https://api.github.com/users/Wauplin/received_events
https://api.github.com/users/Wauplin/repos
https://api.github.com/users/Wauplin/starred{/owner}{/repo}
https://api.github.com/users/Wauplin/subscriptions
User
https://api.github.com/users/Wauplin
public
NONE
Ha yes I had pinned `tokenizers` to an old version so it downgraded `huggingface_hub`. Note to myself keep HuggingFace modules relatively close together chronologically release wise.
2024-01-06T16:13:27Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1879742167
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps5wCpbX
https://api.github.com/repos/huggingface/datasets/issues/comments/1879742167/reactions
2024-01-06T16:13:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1879742167
https://avatars.githubusercontent.com/u/79070834?v=4
https://api.github.com/users/wasertech/events{/privacy}
https://api.github.com/users/wasertech/followers
https://api.github.com/users/wasertech/following{/other_user}
https://api.github.com/users/wasertech/gists{/gist_id}
https://github.com/wasertech
wasertech
MDQ6VXNlcjc5MDcwODM0
https://api.github.com/users/wasertech/orgs
https://api.github.com/users/wasertech/received_events
https://api.github.com/users/wasertech/repos
https://api.github.com/users/wasertech/starred{/owner}{/repo}
https://api.github.com/users/wasertech/subscriptions
User
https://api.github.com/users/wasertech
public
CONTRIBUTOR
Glad to know your problem's solved! 
2024-01-06T20:52:52Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1879825920
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps5wC94A
https://api.github.com/repos/huggingface/datasets/issues/comments/1879825920/reactions
2024-01-06T20:52:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1879825920
https://avatars.githubusercontent.com/u/11801849?v=4
https://api.github.com/users/Wauplin/events{/privacy}
https://api.github.com/users/Wauplin/followers
https://api.github.com/users/Wauplin/following{/other_user}
https://api.github.com/users/Wauplin/gists{/gist_id}
https://github.com/Wauplin
Wauplin
MDQ6VXNlcjExODAxODQ5
https://api.github.com/users/Wauplin/orgs
https://api.github.com/users/Wauplin/received_events
https://api.github.com/users/Wauplin/repos
https://api.github.com/users/Wauplin/starred{/owner}{/repo}
https://api.github.com/users/Wauplin/subscriptions
User
https://api.github.com/users/Wauplin
public
NONE
@Wauplin Thanks for your insight 👍
2024-01-06T21:05:36Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1879829076
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps5wC-pU
https://api.github.com/repos/huggingface/datasets/issues/comments/1879829076/reactions
2024-01-06T21:05:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1879829076
https://avatars.githubusercontent.com/u/79070834?v=4
https://api.github.com/users/wasertech/events{/privacy}
https://api.github.com/users/wasertech/followers
https://api.github.com/users/wasertech/following{/other_user}
https://api.github.com/users/wasertech/gists{/gist_id}
https://github.com/wasertech
wasertech
MDQ6VXNlcjc5MDcwODM0
https://api.github.com/users/wasertech/orgs
https://api.github.com/users/wasertech/received_events
https://api.github.com/users/wasertech/repos
https://api.github.com/users/wasertech/starred{/owner}{/repo}
https://api.github.com/users/wasertech/subscriptions
User
https://api.github.com/users/wasertech
public
NONE
pip install --upgrade huggingface-hub
2024-03-14T02:59:41Z
https://github.com/huggingface/datasets/issues/6563#issuecomment-1996302719
https://api.github.com/repos/huggingface/datasets/issues/6563
IC_kwDODunzps52_Sl_
https://api.github.com/repos/huggingface/datasets/issues/comments/1996302719/reactions
2024-03-14T02:59:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1996302719
https://avatars.githubusercontent.com/u/132160976?v=4
https://api.github.com/users/mercury1216063891/events{/privacy}
https://api.github.com/users/mercury1216063891/followers
https://api.github.com/users/mercury1216063891/following{/other_user}
https://api.github.com/users/mercury1216063891/gists{/gist_id}
https://github.com/mercury1216063891
mercury1216063891
U_kgDOB-Cd0A
https://api.github.com/users/mercury1216063891/orgs
https://api.github.com/users/mercury1216063891/received_events
https://api.github.com/users/mercury1216063891/repos
https://api.github.com/users/mercury1216063891/starred{/owner}{/repo}
https://api.github.com/users/mercury1216063891/subscriptions
User
https://api.github.com/users/mercury1216063891
public
### Describe the bug

Yep its not [there](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/utils/__init__.py) anymore.

```text
+ python /home/trainer/sft_train.py --model_name cognitivecomputations/dolphin-2.2.1-mistral-7b --dataset_name wasertech/OneOS --load_in_4bit --use_peft --batch_size 4 --num_train_epochs 1 --learning_rate 1.41e-5 --gradient_accumulation_steps 8 --seq_length 4096 --output_dir output --log_with wandb
Traceback (most recent call last):
  File "/home/trainer/sft_train.py", line 22, in <module>
    from datasets import load_dataset
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/__init__.py", line 22, in <module>
    from .arrow_dataset import Dataset
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/arrow_dataset.py", line 66, in <module>
    from .arrow_reader import ArrowReader
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/arrow_reader.py", line 30, in <module>
    from .download.download_config import DownloadConfig
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/download/__init__.py", line 9, in <module>
    from .download_manager import DownloadManager, DownloadMode
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/download/download_manager.py", line 31, in <module>
    from ..utils import tqdm as hf_tqdm
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/utils/__init__.py", line 19, in <module>
    from .info_utils import VerificationMode
  File "/home/trainer/llm-train/lib/python3.8/site-packages/datasets/utils/info_utils.py", line 5, in <module>
    from huggingface_hub.utils import insecure_hashlib
ImportError: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (/home/trainer/llm-train/lib/python3.8/site-packages/huggingface_hub/utils/__init__.py)
```

### Steps to reproduce the bug

Using `datasets==2.16.1` and `huggingface_hub== 0.17.3`, load a dataset with `load_dataset`.

### Expected behavior

The dataset should be (downloaded - if needed - and) returned.

### Environment info

```text
trainer@a311ae86939e:/mnt$ pip show datasets
Name: datasets
Version: 2.16.1
Summary: HuggingFace community-driven open-source library of datasets
Home-page: https://github.com/huggingface/datasets
Author: HuggingFace Inc.
Author-email: thomas@huggingface.co
License: Apache 2.0
Location: /home/trainer/llm-train/lib/python3.8/site-packages
Requires: packaging, pyyaml, multiprocess, pyarrow-hotfix, pandas, pyarrow, xxhash, dill, numpy, aiohttp, tqdm, fsspec, requests, filelock, huggingface-hub
Required-by: trl, lm-eval, evaluate

trainer@a311ae86939e:/mnt$ pip show huggingface_hub
Name: huggingface-hub
Version: 0.17.3
Summary: Client library to download and publish models, datasets and other repos on the huggingface.co hub
Home-page: https://github.com/huggingface/huggingface_hub
Author: Hugging Face, Inc.
Author-email: julien@huggingface.co
License: Apache
Location: /home/trainer/llm-train/lib/python3.8/site-packages
Requires: requests, pyyaml, packaging, typing-extensions, tqdm, filelock, fsspec
Required-by: transformers, tokenizers, peft, evaluate, datasets, accelerate

trainer@a311ae86939e:/mnt$ huggingface-cli env

Copy-and-paste the text below in your GitHub issue.

- huggingface_hub version: 0.17.3
- Platform: Linux-6.5.13-7-MANJARO-x86_64-with-glibc2.29
- Python version: 3.8.10
- Running in iPython ?: No
- Running in notebook ?: No
- Running in Google Colab ?: No
- Token path ?: /home/trainer/.cache/huggingface/token
- Has saved token ?: True
- Who am I ?: wasertech
- Configured git credential helpers: 
- FastAI: N/A
- Tensorflow: N/A
- Torch: 2.1.2
- Jinja2: 3.1.2
- Graphviz: N/A
- Pydot: N/A
- Pillow: 10.2.0
- hf_transfer: N/A
- gradio: N/A
- tensorboard: N/A
- numpy: 1.24.4
- pydantic: N/A
- aiohttp: 3.9.1
- ENDPOINT: https://huggingface.co
- HUGGINGFACE_HUB_CACHE: /home/trainer/.cache/huggingface/hub
- HUGGINGFACE_ASSETS_CACHE: /home/trainer/.cache/huggingface/assets
- HF_TOKEN_PATH: /home/trainer/.cache/huggingface/token
- HF_HUB_OFFLINE: False
- HF_HUB_DISABLE_TELEMETRY: False
- HF_HUB_DISABLE_PROGRESS_BARS: None
- HF_HUB_DISABLE_SYMLINKS_WARNING: False
- HF_HUB_DISABLE_EXPERIMENTAL_WARNING: False
- HF_HUB_DISABLE_IMPLICIT_TOKEN: False
- HF_HUB_ENABLE_HF_TRANSFER: False


```