Latest version 2.16.1, when load dataset error occurs. ValueError: BuilderConfig 'allenai--c4' not found. Available: ['default']
MEMBER
Hi ! The "allenai--c4" config doesn't exist (this naming schema comes from old versions of `datasets`)

You can load it this way instead:

```python
from datasets import load_dataset
cache_dir = 'path/to/your/cache/directory'
dataset = load_dataset('allenai/c4', data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}, split='train', cache_dir=cache_dir)
```
2024-01-04T18:20:41Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-1877560522
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps5v6UzK
https://api.github.com/repos/huggingface/datasets/issues/comments/1877560522/reactions
2024-01-04T18:20:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1877560522
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
> Hi ! The "allenai--c4" config doesn't exist (this naming schema comes from old versions of `datasets`)
> 
> You can load it this way instead:
> 
> ```python
> from datasets import load_dataset
> cache_dir = 'path/to/your/cache/directory'
> dataset = load_dataset('allenai/c4', data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}, split='train', cache_dir=cache_dir)
> ```

thanks, the command run successfully in the latest version

2024-01-05T01:26:25Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-1877985568
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps5v78kg
https://api.github.com/repos/huggingface/datasets/issues/comments/1877985568/reactions
2024-01-05T01:26:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1877985568
https://avatars.githubusercontent.com/u/145004780?v=4
https://api.github.com/users/zhulinJulia24/events{/privacy}
https://api.github.com/users/zhulinJulia24/followers
https://api.github.com/users/zhulinJulia24/following{/other_user}
https://api.github.com/users/zhulinJulia24/gists{/gist_id}
https://github.com/zhulinJulia24
zhulinJulia24
U_kgDOCKSY7A
https://api.github.com/users/zhulinJulia24/orgs
https://api.github.com/users/zhulinJulia24/received_events
https://api.github.com/users/zhulinJulia24/repos
https://api.github.com/users/zhulinJulia24/starred{/owner}{/repo}
https://api.github.com/users/zhulinJulia24/subscriptions
User
https://api.github.com/users/zhulinJulia24
public
NONE
> Hi ! The "allenai--c4" config doesn't exist (this naming schema comes from old versions of `datasets`)
> 
> You can load it this way instead:
> 
> ```python
> from datasets import load_dataset
> cache_dir = 'path/to/your/cache/directory'
> dataset = load_dataset('allenai/c4', data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}, split='train', cache_dir=cache_dir)
> ```

@lhoestq 
In this case, should we traverse through al 1024 json files to load the whole dataset?
Thanks!
2024-03-29T08:56:51Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-2026904324
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps540BsE
https://api.github.com/repos/huggingface/datasets/issues/comments/2026904324/reactions
2024-03-29T08:56:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2026904324
https://avatars.githubusercontent.com/u/87317405?v=4
https://api.github.com/users/Edenzzzz/events{/privacy}
https://api.github.com/users/Edenzzzz/followers
https://api.github.com/users/Edenzzzz/following{/other_user}
https://api.github.com/users/Edenzzzz/gists{/gist_id}
https://github.com/Edenzzzz
Edenzzzz
MDQ6VXNlcjg3MzE3NDA1
https://api.github.com/users/Edenzzzz/orgs
https://api.github.com/users/Edenzzzz/received_events
https://api.github.com/users/Edenzzzz/repos
https://api.github.com/users/Edenzzzz/starred{/owner}{/repo}
https://api.github.com/users/Edenzzzz/subscriptions
User
https://api.github.com/users/Edenzzzz
public
MEMBER
It will only load the first file (`data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}` only mentions one file)
2024-03-29T11:28:28Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-2027107295
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps540zPf
https://api.github.com/repos/huggingface/datasets/issues/comments/2027107295/reactions
2024-03-29T11:28:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2027107295
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
> It will only load the first file (`data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}` only mentions one file)

Then what if we want to load the whole dataset?
2024-03-29T11:37:54Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-2027120277
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps5402aV
https://api.github.com/repos/huggingface/datasets/issues/comments/2027120277/reactions
2024-03-29T11:37:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2027120277
https://avatars.githubusercontent.com/u/87317405?v=4
https://api.github.com/users/Edenzzzz/events{/privacy}
https://api.github.com/users/Edenzzzz/followers
https://api.github.com/users/Edenzzzz/following{/other_user}
https://api.github.com/users/Edenzzzz/gists{/gist_id}
https://github.com/Edenzzzz
Edenzzzz
MDQ6VXNlcjg3MzE3NDA1
https://api.github.com/users/Edenzzzz/orgs
https://api.github.com/users/Edenzzzz/received_events
https://api.github.com/users/Edenzzzz/repos
https://api.github.com/users/Edenzzzz/starred{/owner}{/repo}
https://api.github.com/users/Edenzzzz/subscriptions
User
https://api.github.com/users/Edenzzzz
public
MEMBER
There is a "en" subset that you can load (see the list in the "subset" dropdown at https://huggingface.co/datasets/allenai/c4)

```python
dataset = load_dataset('allenai/c4', 'en', split="train")
```

alternatively you can specify all the the files yourself using a glob pattern (or a list):

```python
dataset = load_dataset('allenai/c4', data_files='en/c4-train.00000-of-*.json.gz', split="train")
```
2024-03-29T11:40:48Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-2027122522
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps54029a
https://api.github.com/repos/huggingface/datasets/issues/comments/2027122522/reactions
2024-03-29T11:40:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2027122522
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
> There is a "en" subset that you can load (see the list in the "subset" dropdown at https://huggingface.co/datasets/allenai/c4)
> 
> ```python
> dataset = load_dataset('allenai/c4', 'en', split="train")
> ```
> 
> alternatively you can specify all the the files yourself using a glob pattern (or a list):
> 
> ```python
> dataset = load_dataset('allenai/c4', data_files='en/c4-train.00000-of-*.json.gz', split="train")
> ```

Thanks, the second solution works. The first line simply fails due to missing schema specific to this dataset.
2024-03-30T09:13:12Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-2027985556
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps544JqU
https://api.github.com/repos/huggingface/datasets/issues/comments/2027985556/reactions
2024-03-30T09:13:12Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2027985556
https://avatars.githubusercontent.com/u/87317405?v=4
https://api.github.com/users/Edenzzzz/events{/privacy}
https://api.github.com/users/Edenzzzz/followers
https://api.github.com/users/Edenzzzz/following{/other_user}
https://api.github.com/users/Edenzzzz/gists{/gist_id}
https://github.com/Edenzzzz
Edenzzzz
MDQ6VXNlcjg3MzE3NDA1
https://api.github.com/users/Edenzzzz/orgs
https://api.github.com/users/Edenzzzz/received_events
https://api.github.com/users/Edenzzzz/repos
https://api.github.com/users/Edenzzzz/starred{/owner}{/repo}
https://api.github.com/users/Edenzzzz/subscriptions
User
https://api.github.com/users/Edenzzzz
public
NONE
The latest version of `datasets` seems to have broken my dataset for my users (see this Hugging Face issue: https://huggingface.co/datasets/umarbutler/open-australian-legal-corpus/discussions/3). I changed it by renaming my dataset's config to `default` instead of `train` and then updating my dataset card accordingly.
2024-04-03T10:40:51Z
https://github.com/huggingface/datasets/issues/6559#issuecomment-2034215308
https://api.github.com/repos/huggingface/datasets/issues/6559
IC_kwDODunzps55P6mM
https://api.github.com/repos/huggingface/datasets/issues/comments/2034215308/reactions
2024-04-03T10:40:51Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2034215308
https://avatars.githubusercontent.com/u/8473183?v=4
https://api.github.com/users/umarbutler/events{/privacy}
https://api.github.com/users/umarbutler/followers
https://api.github.com/users/umarbutler/following{/other_user}
https://api.github.com/users/umarbutler/gists{/gist_id}
https://github.com/umarbutler
umarbutler
MDQ6VXNlcjg0NzMxODM=
https://api.github.com/users/umarbutler/orgs
https://api.github.com/users/umarbutler/received_events
https://api.github.com/users/umarbutler/repos
https://api.github.com/users/umarbutler/starred{/owner}{/repo}
https://api.github.com/users/umarbutler/subscriptions
User
https://api.github.com/users/umarbutler
public
### Describe the bug

python script is:
```

from datasets import load_dataset
cache_dir = 'path/to/your/cache/directory'
dataset = load_dataset('allenai/c4','allenai--c4', data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}, split='train',  use_auth_token=False, cache_dir=cache_dir)
```


the script success when datasets version is 2.14.7. 
when using 2.16.1, error occurs
`
ValueError: BuilderConfig 'allenai--c4' not found. Available: ['default']`

### Steps to reproduce the bug

1. pip install datasets==2.16.1
2. run python script:
```

from datasets import load_dataset
cache_dir = 'path/to/your/cache/directory'
dataset = load_dataset('allenai/c4','allenai--c4', data_files={'train': 'en/c4-train.00000-of-01024.json.gz'}, split='train',  use_auth_token=False, cache_dir=cache_dir)
```

### Expected behavior

the dataset should be loaded successful in the latest version. 

### Environment info

datasets 2.16.1