FileNotFoundError for dataset with multiple builder config
NONE
Please tell me if the above info is not enough for solving the problem. I will then make my dataset public temporarily so that you can really reproduce the bug. 
2023-10-02T05:03:40Z
https://github.com/huggingface/datasets/issues/6274#issuecomment-1742404002
https://api.github.com/repos/huggingface/datasets/issues/6274
IC_kwDODunzps5n2vmi
https://api.github.com/repos/huggingface/datasets/issues/comments/1742404002/reactions
2023-10-02T05:03:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1742404002
https://avatars.githubusercontent.com/u/97120485?v=4
https://api.github.com/users/LouisChen15/events{/privacy}
https://api.github.com/users/LouisChen15/followers
https://api.github.com/users/LouisChen15/following{/other_user}
https://api.github.com/users/LouisChen15/gists{/gist_id}
https://github.com/LouisChen15
LouisChen15
U_kgDOBcnw5Q
https://api.github.com/users/LouisChen15/orgs
https://api.github.com/users/LouisChen15/received_events
https://api.github.com/users/LouisChen15/repos
https://api.github.com/users/LouisChen15/starred{/owner}{/repo}
https://api.github.com/users/LouisChen15/subscriptions
User
https://api.github.com/users/LouisChen15
public
NONE
Hi! 
Could you share how to solve this problem? 
I faced this same error. 
2024-08-14T04:41:50Z
https://github.com/huggingface/datasets/issues/6274#issuecomment-2287842749
https://api.github.com/repos/huggingface/datasets/issues/6274
IC_kwDODunzps6IXbW9
https://api.github.com/repos/huggingface/datasets/issues/comments/2287842749/reactions
2024-08-14T04:42:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2287842749
https://avatars.githubusercontent.com/u/49199790?v=4
https://api.github.com/users/seobeomjin/events{/privacy}
https://api.github.com/users/seobeomjin/followers
https://api.github.com/users/seobeomjin/following{/other_user}
https://api.github.com/users/seobeomjin/gists{/gist_id}
https://github.com/seobeomjin
seobeomjin
MDQ6VXNlcjQ5MTk5Nzkw
https://api.github.com/users/seobeomjin/orgs
https://api.github.com/users/seobeomjin/received_events
https://api.github.com/users/seobeomjin/repos
https://api.github.com/users/seobeomjin/starred{/owner}{/repo}
https://api.github.com/users/seobeomjin/subscriptions
User
https://api.github.com/users/seobeomjin
public
### Describe the bug

When there is only one config and only the dataset name is entered when using datasets.load_dataset(), it works fine. But if I create a second builder_config for my dataset and enter the config name when using datasets.load_dataset(), the following error will happen.

FileNotFoundError: [Errno 2] No such file or directory: 'C:/Users/chenx/.cache/huggingface/datasets/my_dataset/0_shot_multiple_choice/1.0.0/97c3854a012cfd6b045e3be4c864739902af2d818bb9235b047baa94c302e9a2.incomplete/my_dataset-test-00000-00000-of-NNNNN.arrow'

The "XXX.incomplete folder" in the cache folder of my dataset will disappear before "generating test split", which does not happen when config name is not entered and the config name is "default"

C:\Users\chenx\.cache\huggingface\datasets\my_dataset\0_shot_multiple_choice\1.0.0    
The folder that is supposed to remain under the above directory will disappear, and the data generator will not have a place to generate data into. 

### Steps to reproduce the bug

test = load_dataset('my_dataset', '0_shot_multiple_choice')

### Expected behavior

FileNotFoundError: [Errno 2] No such file or directory: 'C:/Users/chenx/.cache/huggingface/datasets/my_dataset/0_shot_multiple_choice/1.0.0/97c3854a012cfd6b045e3be4c864739902af2d818bb9235b047baa94c302e9a2.incomplete/my_dataset-test-00000-00000-of-NNNNN.arrow'

### Environment info

datasets                  2.14.5
python                    3.8.18