Bug: Error when downloading mteb/mtop_domain
MEMBER
Could you please try with `force_redownload` instead?
EDIT:
```python
data = load_dataset("mteb/mtop_domain", "en", download_mode="force_redownload")
```
2024-09-13T04:43:32Z
https://github.com/huggingface/datasets/issues/7148#issuecomment-2348021166
https://api.github.com/repos/huggingface/datasets/issues/7148
IC_kwDODunzps6L8_Wu
https://api.github.com/repos/huggingface/datasets/issues/comments/2348021166/reactions
2024-09-13T04:57:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2348021166
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Seems the error is still there
2024-09-13T06:22:53Z
https://github.com/huggingface/datasets/issues/7148#issuecomment-2348126709
https://api.github.com/repos/huggingface/datasets/issues/7148
IC_kwDODunzps6L9ZH1
https://api.github.com/repos/huggingface/datasets/issues/comments/2348126709/reactions
2024-09-13T06:22:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2348126709
https://avatars.githubusercontent.com/u/77958037?v=4
https://api.github.com/users/ZiyiXia/events{/privacy}
https://api.github.com/users/ZiyiXia/followers
https://api.github.com/users/ZiyiXia/following{/other_user}
https://api.github.com/users/ZiyiXia/gists{/gist_id}
https://github.com/ZiyiXia
ZiyiXia
MDQ6VXNlcjc3OTU4MDM3
https://api.github.com/users/ZiyiXia/orgs
https://api.github.com/users/ZiyiXia/received_events
https://api.github.com/users/ZiyiXia/repos
https://api.github.com/users/ZiyiXia/starred{/owner}{/repo}
https://api.github.com/users/ZiyiXia/subscriptions
User
https://api.github.com/users/ZiyiXia
public
MEMBER
I am not able to reproduce the issue:
```python
In [1]: from datasets import load_dataset

In [2]: data = load_dataset("mteb/mtop_domain", "en")

In [3]: data
Out[3]: DatasetDict({
    train: Dataset({
        features: ['id', 'text', 'label', 'label_text'],
        num_rows: 15667
    })
    validation: Dataset({
        features: ['id', 'text', 'label', 'label_text'],
        num_rows: 2235
    })
    test: Dataset({
        features: ['id', 'text', 'label', 'label_text'],
        num_rows: 4386
    })
})
```
2024-09-13T06:37:04Z
https://github.com/huggingface/datasets/issues/7148#issuecomment-2348144244
https://api.github.com/repos/huggingface/datasets/issues/7148
IC_kwDODunzps6L9dZ0
https://api.github.com/repos/huggingface/datasets/issues/comments/2348144244/reactions
2024-09-13T06:37:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2348144244
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Just solved this by reinstall Huggingface Hub and datasets. Thanks for your help!
2024-09-14T03:06:48Z
https://github.com/huggingface/datasets/issues/7148#issuecomment-2350805742
https://api.github.com/repos/huggingface/datasets/issues/7148
IC_kwDODunzps6MHnLu
https://api.github.com/repos/huggingface/datasets/issues/comments/2350805742/reactions
2024-09-14T03:06:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2350805742
https://avatars.githubusercontent.com/u/77958037?v=4
https://api.github.com/users/ZiyiXia/events{/privacy}
https://api.github.com/users/ZiyiXia/followers
https://api.github.com/users/ZiyiXia/following{/other_user}
https://api.github.com/users/ZiyiXia/gists{/gist_id}
https://github.com/ZiyiXia
ZiyiXia
MDQ6VXNlcjc3OTU4MDM3
https://api.github.com/users/ZiyiXia/orgs
https://api.github.com/users/ZiyiXia/received_events
https://api.github.com/users/ZiyiXia/repos
https://api.github.com/users/ZiyiXia/starred{/owner}{/repo}
https://api.github.com/users/ZiyiXia/subscriptions
User
https://api.github.com/users/ZiyiXia
public
### Describe the bug

When downloading the dataset "mteb/mtop_domain", ran into the following error:

```
Traceback (most recent call last):
  File "/share/project/xzy/test/test_download.py", line 3, in <module>
    data = load_dataset("mteb/mtop_domain", "en", trust_remote_code=True)
  File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 2606, in load_dataset
    builder_instance = load_dataset_builder(
  File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 2277, in load_dataset_builder
    dataset_module = dataset_module_factory(
  File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1923, in dataset_module_factory
    raise e1 from None
  File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1896, in dataset_module_factory
    ).get_module()
  File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1507, in get_module
    local_path = self.download_loading_script()
  File "/opt/conda/lib/python3.10/site-packages/datasets/load.py", line 1467, in download_loading_script
    return cached_path(file_path, download_config=download_config)
  File "/opt/conda/lib/python3.10/site-packages/datasets/utils/file_utils.py", line 211, in cached_path
    output_path = get_from_cache(
  File "/opt/conda/lib/python3.10/site-packages/datasets/utils/file_utils.py", line 689, in get_from_cache
    fsspec_get(
  File "/opt/conda/lib/python3.10/site-packages/datasets/utils/file_utils.py", line 395, in fsspec_get
    fs.get_file(path, temp_file.name, callback=callback)
  File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/hf_file_system.py", line 648, in get_file
    http_get(
  File "/opt/conda/lib/python3.10/site-packages/huggingface_hub/file_download.py", line 578, in http_get
    raise EnvironmentError(
OSError: Consistency check failed: file should be of size 2191 but has size 2190 ((…)ets/mteb/mtop_domain@main/mtop_domain.py).
We are sorry for the inconvenience. Please retry with `force_download=True`.
If the issue persists, please let us know by opening an issue on https://github.com/huggingface/huggingface_hub.
```
Try to download through HF datasets directly but got the same error as above.
```python
from datasets import load_dataset

data = load_dataset("mteb/mtop_domain", "en")
```

### Steps to reproduce the bug

```python
from datasets import load_dataset

data = load_dataset("mteb/mtop_domain", "en", force_download=True)
```
With and without `force_download=True` both ran into the same error.

### Expected behavior

Should download the dataset successfully.

### Environment info

- datasets version: 2.21.0
- huggingface-hub version: 0.24.6