FileNotFoundError：error  when loading C4 dataset
NONE
same problem here
2024-06-04T07:18:36Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2146786924
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps5_9V5s
https://api.github.com/repos/huggingface/datasets/issues/comments/2146786924/reactions
2024-06-04T07:18:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2146786924
https://avatars.githubusercontent.com/u/71201052?v=4
https://api.github.com/users/Aaronhuang-778/events{/privacy}
https://api.github.com/users/Aaronhuang-778/followers
https://api.github.com/users/Aaronhuang-778/following{/other_user}
https://api.github.com/users/Aaronhuang-778/gists{/gist_id}
https://github.com/Aaronhuang-778
Aaronhuang-778
MDQ6VXNlcjcxMjAxMDUy
https://api.github.com/users/Aaronhuang-778/orgs
https://api.github.com/users/Aaronhuang-778/received_events
https://api.github.com/users/Aaronhuang-778/repos
https://api.github.com/users/Aaronhuang-778/starred{/owner}{/repo}
https://api.github.com/users/Aaronhuang-778/subscriptions
User
https://api.github.com/users/Aaronhuang-778
public
MEMBER
Hello,

Are you sure you are really using datasets version 2.19.2? We just made the patch release yesterday specifically to fix this issue:
- #6925

I can't reproduce the error:
```python
In [1]: from datasets import load_dataset

In [2]: ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation')
Downloading readme: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 41.1k/41.1k [00:00<00:00, 596kB/s]
Downloading data: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 40.7M/40.7M [00:04<00:00, 8.50MB/s]
Generating validation split: 45576 examples [00:01, 44956.75 examples/s]

In [3]: ds
Out[3]: 
Dataset({
    features: ['text', 'timestamp', 'url'],
    num_rows: 45576
})
```
2024-06-04T11:20:32Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2147282299
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps5__O17
https://api.github.com/repos/huggingface/datasets/issues/comments/2147282299/reactions
2024-06-04T11:20:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2147282299
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
> Hello,
> 
> Are you sure you are really using datasets version 2.19.2? We just made the patch release yesterday specifically to fix this issue:
> 
> * [Fix NonMatchingSplitsSizesError/ExpectedMoreSplits when passing data_dir/data_files in no-code Hub datasets #6925](https://github.com/huggingface/datasets/pull/6925)
> 
> I can't reproduce the error:
> 
> ```python
> In [1]: from datasets import load_dataset
> 
> In [2]: ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation')
> Downloading readme: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 41.1k/41.1k [00:00<00:00, 596kB/s]
> Downloading data: 100%|████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 40.7M/40.7M [00:04<00:00, 8.50MB/s]
> Generating validation split: 45576 examples [00:01, 44956.75 examples/s]
> 
> In [3]: ds
> Out[3]: 
> Dataset({
>     features: ['text', 'timestamp', 'url'],
>     num_rows: 45576
> })
> ```
Thank you for your reply,ExpectedMoreSplits was encountered in datasets version 2.12.2. After I updated the version, that is, datasets version 2.19.2, I encountered the FileNotFoundError problem mentioned above.
2024-06-04T11:53:09Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2147341655
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps5__dVX
https://api.github.com/repos/huggingface/datasets/issues/comments/2147341655/reactions
2024-06-04T11:53:09Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2147341655
https://avatars.githubusercontent.com/u/62374585?v=4
https://api.github.com/users/W-215/events{/privacy}
https://api.github.com/users/W-215/followers
https://api.github.com/users/W-215/following{/other_user}
https://api.github.com/users/W-215/gists{/gist_id}
https://github.com/W-215
W-215
MDQ6VXNlcjYyMzc0NTg1
https://api.github.com/users/W-215/orgs
https://api.github.com/users/W-215/received_events
https://api.github.com/users/W-215/repos
https://api.github.com/users/W-215/starred{/owner}{/repo}
https://api.github.com/users/W-215/subscriptions
User
https://api.github.com/users/W-215
public
MEMBER
That might be due to a corrupted cache.

Please, retry loading the dataset passing: `download_mode="force_redownload"`
```python
ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation', download_mode="force_redownload")
```

It the above command does not fix the issue, then you will need to fix the cache manually, by removing the corresponding directory inside `~/.cache/huggingface/`.

2024-06-04T12:18:59Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2147394887
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps5__qVH
https://api.github.com/repos/huggingface/datasets/issues/comments/2147394887/reactions
2024-06-04T12:18:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2147394887
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
> That might be due to a corrupted cache.
> 
> Please, retry loading the dataset passing: `download_mode="force_redownload"`
> 
> ```python
> ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation', download_mode="force_redownload")
> ```
> 
> It the above command does not fix the issue, then you will need to fix the cache manually, by removing the corresponding directory inside `~/.cache/huggingface/`.

The two methods you mentioned above can not solve this problem, but the command line interface shows Downloading readme: 41.1kB [00:00, 281kB/s], and then FileNotFoundError appears. It is worth noting that I have no problem loading other datasets with the initial method, such as wikitext datasets
2024-06-04T12:48:38Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2147453597
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps5__4qd
https://api.github.com/repos/huggingface/datasets/issues/comments/2147453597/reactions
2024-06-04T12:48:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2147453597
https://avatars.githubusercontent.com/u/62374585?v=4
https://api.github.com/users/W-215/events{/privacy}
https://api.github.com/users/W-215/followers
https://api.github.com/users/W-215/following{/other_user}
https://api.github.com/users/W-215/gists{/gist_id}
https://github.com/W-215
W-215
MDQ6VXNlcjYyMzc0NTg1
https://api.github.com/users/W-215/orgs
https://api.github.com/users/W-215/received_events
https://api.github.com/users/W-215/repos
https://api.github.com/users/W-215/starred{/owner}{/repo}
https://api.github.com/users/W-215/subscriptions
User
https://api.github.com/users/W-215
public
NONE
> The two methods you mentioned above can not solve this problem, but the command line interface shows Downloading readme: 41.1kB [00:00, 281kB/s], and then FileNotFoundError appears.

Same issue encountered.

2024-06-19T02:58:54Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2177451817
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6ByUcp
https://api.github.com/repos/huggingface/datasets/issues/comments/2177451817/reactions
2024-06-19T02:58:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2177451817
https://avatars.githubusercontent.com/u/63796752?v=4
https://api.github.com/users/ZhangGe6/events{/privacy}
https://api.github.com/users/ZhangGe6/followers
https://api.github.com/users/ZhangGe6/following{/other_user}
https://api.github.com/users/ZhangGe6/gists{/gist_id}
https://github.com/ZhangGe6
ZhangGe6
MDQ6VXNlcjYzNzk2NzUy
https://api.github.com/users/ZhangGe6/orgs
https://api.github.com/users/ZhangGe6/received_events
https://api.github.com/users/ZhangGe6/repos
https://api.github.com/users/ZhangGe6/starred{/owner}{/repo}
https://api.github.com/users/ZhangGe6/subscriptions
User
https://api.github.com/users/ZhangGe6
public
MEMBER
I really think the issue is caused by a corrupted cache, between versions 2.12.0 (there does not exist 2.12.2 version) and 2.19.2.

Are you sure you removed all the corresponding corrupted directories within the cache?

You can easily check if the issue is caused by a corrupted cache by removing the entire cache:
```shell
mv ~/.cache/huggingface ~/.cache/huggingface.bak
```
and then reloading the dataset:
```python
ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation', download_mode="force_redownload")
```
2024-06-19T06:18:16Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2177836240
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6BzyTQ
https://api.github.com/repos/huggingface/datasets/issues/comments/2177836240/reactions
2024-06-19T06:18:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2177836240
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
@albertvillanova Thanks for the reply. I tried removing the entire cache and reloading the dataset as you suggest. However, the same issue still exists. 

As a test, I switch to a new platform, which (is a Windows system and) hasn't downloaded huggingface dataset before, and the dataset is loaded successfully. So I think "a corrupted cache" explanation makes sense. I wonder, besides `~/.cache/huggingface`, is there any other directory that may save the cache thing?

As a side note, I am using `datasets==2.20.0` and proxy `export HF_ENDPOINT=https://hf-mirror.com`.
2024-06-20T01:18:42Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2179647593
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6B6shp
https://api.github.com/repos/huggingface/datasets/issues/comments/2179647593/reactions
2024-06-20T01:18:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2179647593
https://avatars.githubusercontent.com/u/63796752?v=4
https://api.github.com/users/ZhangGe6/events{/privacy}
https://api.github.com/users/ZhangGe6/followers
https://api.github.com/users/ZhangGe6/following{/other_user}
https://api.github.com/users/ZhangGe6/gists{/gist_id}
https://github.com/ZhangGe6
ZhangGe6
MDQ6VXNlcjYzNzk2NzUy
https://api.github.com/users/ZhangGe6/orgs
https://api.github.com/users/ZhangGe6/received_events
https://api.github.com/users/ZhangGe6/repos
https://api.github.com/users/ZhangGe6/starred{/owner}{/repo}
https://api.github.com/users/ZhangGe6/subscriptions
User
https://api.github.com/users/ZhangGe6
public
MEMBER
Ho @ZhangGe6,

As far as I know, that directory is the only one where the cache is saved, unless you configured another one. You can check it:
```python
import datasets.config

print(datasets.config.HF_CACHE_HOME)
# ~/.cache/huggingface

print(datasets.config.HF_DATASETS_CACHE)
# ~/.cache/huggingface/datasets

print(datasets.config.HF_MODULES_CACHE)
# ~/.cache/huggingface/modules

print(datasets.config.DOWNLOADED_DATASETS_PATH)
# ~/.cache/huggingface/datasets/downloads

print(datasets.config.EXTRACTED_DATASETS_PATH)
# ~/.cache/huggingface/datasets/downloads/extracted
```

Additionally, `datasets` uses `huggingface_hub`, but its cache directory should also be inside `~/.cache/huggingface`, unless you configured another one. You can check it:
```python
import huggingface_hub.constants

print(huggingface_hub.constants.HF_HOME)
# ~/.cache/huggingface

print(huggingface_hub.constants.HF_HUB_CACHE)
# ~/.cache/huggingface/hub
```
2024-06-20T04:48:04Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2179800343
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6B7R0X
https://api.github.com/repos/huggingface/datasets/issues/comments/2179800343/reactions
2024-06-20T04:58:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2179800343
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
@albertvillanova I checked the directories you listed, and find that they are the same as the ones you provided. I am going to find more clues and will update what I find here.
2024-06-20T06:09:16Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2179892562
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6B7oVS
https://api.github.com/repos/huggingface/datasets/issues/comments/2179892562/reactions
2024-06-20T06:09:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2179892562
https://avatars.githubusercontent.com/u/63796752?v=4
https://api.github.com/users/ZhangGe6/events{/privacy}
https://api.github.com/users/ZhangGe6/followers
https://api.github.com/users/ZhangGe6/following{/other_user}
https://api.github.com/users/ZhangGe6/gists{/gist_id}
https://github.com/ZhangGe6
ZhangGe6
MDQ6VXNlcjYzNzk2NzUy
https://api.github.com/users/ZhangGe6/orgs
https://api.github.com/users/ZhangGe6/received_events
https://api.github.com/users/ZhangGe6/repos
https://api.github.com/users/ZhangGe6/starred{/owner}{/repo}
https://api.github.com/users/ZhangGe6/subscriptions
User
https://api.github.com/users/ZhangGe6
public
NONE
I've had a similar problem, and for some reason decreasing the number of workers in the dataloader solved it
2024-06-20T10:45:16Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2180371686
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6B9dTm
https://api.github.com/repos/huggingface/datasets/issues/comments/2180371686/reactions
2024-06-20T10:45:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2180371686
https://avatars.githubusercontent.com/u/47751420?v=4
https://api.github.com/users/Francesco215/events{/privacy}
https://api.github.com/users/Francesco215/followers
https://api.github.com/users/Francesco215/following{/other_user}
https://api.github.com/users/Francesco215/gists{/gist_id}
https://github.com/Francesco215
Francesco215
MDQ6VXNlcjQ3NzUxNDIw
https://api.github.com/users/Francesco215/orgs
https://api.github.com/users/Francesco215/received_events
https://api.github.com/users/Francesco215/repos
https://api.github.com/users/Francesco215/starred{/owner}{/repo}
https://api.github.com/users/Francesco215/subscriptions
User
https://api.github.com/users/Francesco215
public
NONE
Same issue.

2024-06-22T02:10:36Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2183699232
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6CKJsg
https://api.github.com/repos/huggingface/datasets/issues/comments/2183699232/reactions
2024-06-22T02:10:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2183699232
https://avatars.githubusercontent.com/u/18393537?v=4
https://api.github.com/users/tzm1003306213/events{/privacy}
https://api.github.com/users/tzm1003306213/followers
https://api.github.com/users/tzm1003306213/following{/other_user}
https://api.github.com/users/tzm1003306213/gists{/gist_id}
https://github.com/tzm1003306213
tzm1003306213
MDQ6VXNlcjE4MzkzNTM3
https://api.github.com/users/tzm1003306213/orgs
https://api.github.com/users/tzm1003306213/received_events
https://api.github.com/users/tzm1003306213/repos
https://api.github.com/users/tzm1003306213/starred{/owner}{/repo}
https://api.github.com/users/tzm1003306213/subscriptions
User
https://api.github.com/users/tzm1003306213
public
NONE
Hi folks. Finally, I find it is a network issue that causes huggingface hub unreachable (in China).

To run the following script 
```python
from datasets import load_dataset

ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation', download_mode="force_redownload")
```
Without setting `export HF_ENDPOINT=https://hf-mirror.com`, I get the following error log
```bash
Traceback (most recent call last):
  File ".\demo.py", line 8, in <module>
    ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation', download_mode="force_redownload")
  File "D:\SoftwareInstall\Python\lib\site-packages\datasets\load.py", line 2594, in load_dataset
    builder_instance = load_dataset_builder(
  File "D:\SoftwareInstall\Python\lib\site-packages\datasets\load.py", line 2266, in load_dataset_builder
    dataset_module = dataset_module_factory(
  File "D:\SoftwareInstall\Python\lib\site-packages\datasets\load.py", line 1914, in dataset_module_factory
    raise e1 from None
  File "D:\SoftwareInstall\Python\lib\site-packages\datasets\load.py", line 1845, in dataset_module_factory
    raise ConnectionError(f"Couldn't reach '{path}' on the Hub ({e.__class__.__name__})") from e
ConnectionError: Couldn't reach 'allenai/c4' on the Hub (ConnectionError)
```
After setting `export HF_ENDPOINT=https://hf-mirror.com`, I get the following error, which is exactly the same as what we are debugging in this issue
```bash
Downloading readme: 41.1kB [00:00, 41.1MB/s]
Traceback (most recent call last):
  File ".\demo.py", line 8, in <module>
    ds = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation', download_mode="force_redownload")
  File "D:\SoftwareInstall\Python\lib\site-packages\datasets\load.py", line 2594, in loa    builder_instance = load_dataset_builder(
  File "D:\SoftwareInstall\Python\lib\site-packages\datasets\load.py", line 2266, in load_dataset_builder
    dataset_module = dataset_module_factory(
    raise FileNotFoundError(
FileNotFoundError: Couldn't find a dataset script at C:\Users\ZhangGe\Desktop\allenai\c4\c4.py or any data file in the same directory. Couldn't find 'allenai/c4' on the Hugging Face Hub either: FileNotFoundError: Unable to find 'hf://datasets/allenai/c4@1588ec454eed extension ['.csv', '.tsv', '.json', '.jsonl', '.parquet', '.geoparquet', '.gpq', '.arrow', '.txt', '.tar', '.blp', '.bmp', '.dib', '.bufr', '.cur', '.pcx', '.dcx', '.dds', '.ps', '.eps', '.fit', '.fits', '.fli', '.flc', '.ftc', '.ftu', '.gbr', '.gif', '.grib', 
'.h5', '.hdf', '.png', '.apng', '.jp2', '.j2k', '.jpc', '.jpf', '.jpx', '.j2c', '.icns',pm', '.BLP', '.BMP', '.DIB', '.BUFR', '.CUR', '.PCX', '.DCX', '.DDS', '.PS', '.EPS', '.FIT', '.FITS', '.FLI', '.FLC', '.FTC', '.FTU', '.GBR', '.GIF', '.GRIB', '.H5', '.HDF', '.PNG', '.APNG', '.JP2', '.J2K', '.JPC', '.JPF', '.JPX', '.J2C', '.ICNS', '.ICO', '.IM', '.IIM', '.TIF', '.TIFF', '.JFIF', '.JPE', '.JPG', '.JPEG', '.MPG', '.MPEG', '.MSP', '.PCD', '.PXR', '.PBM', '.PGM', '.PPM', '.PNM', '.PSD', '.BW', '.RGB', '.RGBA', '.SGI', '.RAS', '.TGA', '.ICB', '.VDA', '.VST', '.WEBP', '.WMF', '.EMF', '.XBM', '.XPM', '.aiff', '.au', '.avr', '.caf', '.flac', '.htk', '.svx', '.mat4', '.mat5', '.mpc2k', '.ogg', '.paf', '.pvf', '.raw', '.rf64', '.sd2', '.sds', '.ircam', '.voc', '.w64', '.wav', '.nist', '.wavex', '.wve', '.xi', '.mp3', '.opus', '.AIFF', '.AU', '.AVR', '.CAF', '.FLAC', '.HTK', 
'.SVX', '.MAT4', '.MAT5', '.MPC2K', '.OGG', '.PAF', '.PVF', '.RAW', '.RF64', '.SD2', '.SDS', '.IRCAM', '.VOC', '.W64', '.WAV', '.NIST', '.WAVEX', '.WVE', '.XI', '.MP3', '.OPUS', '.zip']
```

**Using a proxy software that avoids the internet access restrictions imposed by China, I can download the dataset using the same script**
```bash
Downloading readme: 100%|███████████████████████████████████████████| 41.1k/41.1k [00:00<00:00, 312kB/s] 
Downloading data: 100%|████████████████████████████████████████████| 40.7M/40.7M [00:19<00:00, 2.07MB/s] 
Generating validation split: 45576 examples [00:00, 54883.48 examples/s]
```
So `allenai/c4` is still unreachable even after setting `export HF_ENDPOINT=https://hf-mirror.com`.
2024-06-24T14:39:25Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2186741616
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6CVwdw
https://api.github.com/repos/huggingface/datasets/issues/comments/2186741616/reactions
2024-06-24T14:39:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2186741616
https://avatars.githubusercontent.com/u/63796752?v=4
https://api.github.com/users/ZhangGe6/events{/privacy}
https://api.github.com/users/ZhangGe6/followers
https://api.github.com/users/ZhangGe6/following{/other_user}
https://api.github.com/users/ZhangGe6/gists{/gist_id}
https://github.com/ZhangGe6
ZhangGe6
MDQ6VXNlcjYzNzk2NzUy
https://api.github.com/users/ZhangGe6/orgs
https://api.github.com/users/ZhangGe6/received_events
https://api.github.com/users/ZhangGe6/repos
https://api.github.com/users/ZhangGe6/starred{/owner}{/repo}
https://api.github.com/users/ZhangGe6/subscriptions
User
https://api.github.com/users/ZhangGe6
public
NONE
I have created an issue to inform the maintainers of `hf-mirror`：https://github.com/padeoe/hf-mirror-site/issues/30
2024-06-24T14:52:13Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2186770504
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6CV3hI
https://api.github.com/repos/huggingface/datasets/issues/comments/2186770504/reactions
2024-06-24T14:52:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2186770504
https://avatars.githubusercontent.com/u/63796752?v=4
https://api.github.com/users/ZhangGe6/events{/privacy}
https://api.github.com/users/ZhangGe6/followers
https://api.github.com/users/ZhangGe6/following{/other_user}
https://api.github.com/users/ZhangGe6/gists{/gist_id}
https://github.com/ZhangGe6
ZhangGe6
MDQ6VXNlcjYzNzk2NzUy
https://api.github.com/users/ZhangGe6/orgs
https://api.github.com/users/ZhangGe6/received_events
https://api.github.com/users/ZhangGe6/repos
https://api.github.com/users/ZhangGe6/starred{/owner}{/repo}
https://api.github.com/users/ZhangGe6/subscriptions
User
https://api.github.com/users/ZhangGe6
public
MEMBER
Thanks for the investigation: so finally it is an issue with the specific endpoint you are using.

You properly opened an issue in their repo, so they can fix it.

I am closing this issue here.
2024-06-25T06:21:28Z
https://github.com/huggingface/datasets/issues/6947#issuecomment-2188073652
https://api.github.com/repos/huggingface/datasets/issues/6947
IC_kwDODunzps6Ca1q0
https://api.github.com/repos/huggingface/datasets/issues/comments/2188073652/reactions
2024-06-25T06:21:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2188073652
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
### Describe the bug

can't load c4 datasets

When I replace the datasets package to 2.12.2 I get raise datasets.utils.info_utils.ExpectedMoreSplits: {'train'}

How can I fix this？

### Steps to reproduce the bug

1.from datasets import load_dataset
2.dataset = load_dataset('allenai/c4', data_files={'validation': 'en/c4-validation.00003-of-00008.json.gz'}, split='validation')
3.   raise FileNotFoundError(
FileNotFoundError: Couldn't find a dataset script at local_path/c4_val/allenai/c4/c4.py or any data file in the same directory. Couldn't find 'allenai/c4' on the Hugging Face Hub either: FileNotFoundError: Unable to find 'hf://datasets/allenai/c4@1588ec454efa1a09f29cd18ddd04fe05fc8653a2/en/c4-validation.00003-of-00008.json.gz' with any supported extension ['.csv', '.tsv', '.json', '.jsonl', '.parquet', '.geoparquet', '.gpq', '.arrow', '.txt', '.tar', '.blp', '.bmp', '.dib', '.bufr', '.cur', '.pcx', '.dcx', '.dds', '.ps', '.eps', '.fit', '.fits', '.fli', '.flc', '.ftc', '.ftu', '.gbr', '.gif', '.grib', '.h5', '.hdf', '.png', '.apng', '.jp2', '.j2k', '.jpc', '.jpf', '.jpx', '.j2c', '.icns', '.ico', '.im', '.iim', '.tif', '.tiff', '.jfif', '.jpe', '.jpg', '.jpeg', '.mpg', '.mpeg', '.msp', '.pcd', '.pxr', '.pbm', '.pgm', '.ppm', '.pnm', '.psd', '.bw', '.rgb', '.rgba', '.sgi', '.ras', '.tga', '.icb', '.vda', '.vst', '.webp', '.wmf', '.emf', '.xbm', '.xpm', '.BLP', '.BMP', '.DIB', '.BUFR', '.CUR', '.PCX', '.DCX', '.DDS', '.PS', '.EPS', '.FIT', '.FITS', '.FLI', '.FLC', '.FTC', '.FTU', '.GBR', '.GIF', '.GRIB', '.H5', '.HDF', '.PNG', '.APNG', '.JP2', '.J2K', '.JPC', '.JPF', '.JPX', '.J2C', '.ICNS', '.ICO', '.IM', '.IIM', '.TIF', '.TIFF', '.JFIF', '.JPE', '.JPG', '.JPEG', '.MPG', '.MPEG', '.MSP', '.PCD', '.PXR', '.PBM', '.PGM', '.PPM', '.PNM', '.PSD', '.BW', '.RGB', '.RGBA', '.SGI', '.RAS', '.TGA', '.ICB', '.VDA', '.VST', '.WEBP', '.WMF', '.EMF', '.XBM', '.XPM', '.aiff', '.au', '.avr', '.caf', '.flac', '.htk', '.svx', '.mat4', '.mat5', '.mpc2k', '.ogg', '.paf', '.pvf', '.raw', '.rf64', '.sd2', '.sds', '.ircam', '.voc', '.w64', '.wav', '.nist', '.wavex', '.wve', '.xi', '.mp3', '.opus', '.AIFF', '.AU', '.AVR', '.CAF', '.FLAC', '.HTK', '.SVX', '.MAT4', '.MAT5', '.MPC2K', '.OGG', '.PAF', '.PVF', '.RAW', '.RF64', '.SD2', '.SDS', '.IRCAM', '.VOC', '.W64', '.WAV', '.NIST', '.WAVEX', '.WVE', '.XI', '.MP3', '.OPUS', '.zip']
### Expected behavior


The data was successfully imported

### Environment info

python version 3.9
datasets version 2.19.2