Possible caching bug
MEMBER
Thanks for reporting. That's a bug indeed.
Apparently only the `data_files` parameter is taken into account right now in `DatasetBuilder._create_builder_config` but it should also be the case for `config_kwargs` (or at least the instantiated `builder_config`)
2020-10-14T09:35:22Z
https://github.com/huggingface/datasets/issues/730#issuecomment-708284246
https://api.github.com/repos/huggingface/datasets/issues/730
MDEyOklzc3VlQ29tbWVudDcwODI4NDI0Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/708284246/reactions
2020-10-14T09:35:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/708284246
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hi, does this bug be fixed? when I load JSON files, I get the same errors by the command 
`!python3 run.py --do_train --task qa --dataset squad-retrain-data/train-v2.0.json --output_dir ./re_trained_model/`

change the dateset to load json by refering to https://huggingface.co/docs/datasets/loading.html
`dataset = datasets.load_dataset('json', data_files=args.dataset)`

Errors:
`Downloading and preparing dataset json/default (download: Unknown size, generated: Unknown size, post-processed: Unknown size, total: Unknown size) to /root/.cache/huggingface/datasets/json/default-c1e124ad488911b8/0.0.0/45636811569ec4a6630521c18235dfbbab83b7ab572e3393c5ba68ccabe98264...
`
2021-11-28T14:28:56Z
https://github.com/huggingface/datasets/issues/730#issuecomment-981095050
https://api.github.com/repos/huggingface/datasets/issues/730
IC_kwDODunzps46elKK
https://api.github.com/repos/huggingface/datasets/issues/comments/981095050/reactions
2021-11-28T14:28:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/981095050
https://avatars.githubusercontent.com/u/38966558?v=4
https://api.github.com/users/PatricYan/events{/privacy}
https://api.github.com/users/PatricYan/followers
https://api.github.com/users/PatricYan/following{/other_user}
https://api.github.com/users/PatricYan/gists{/gist_id}
https://github.com/PatricYan
PatricYan
MDQ6VXNlcjM4OTY2NTU4
https://api.github.com/users/PatricYan/orgs
https://api.github.com/users/PatricYan/received_events
https://api.github.com/users/PatricYan/repos
https://api.github.com/users/PatricYan/starred{/owner}{/repo}
https://api.github.com/users/PatricYan/subscriptions
User
https://api.github.com/users/PatricYan
public
NONE
```ds = load_dataset("csv", data_files={'train': 'train.csv', 'test': 'test.csv'})```

Gives the output
```Using custom data configuration default-5c8ae7c208631aca```

and the code hangs there.
2022-11-20T16:27:52Z
https://github.com/huggingface/datasets/issues/730#issuecomment-1321174723
https://api.github.com/repos/huggingface/datasets/issues/730
IC_kwDODunzps5Ov4bD
https://api.github.com/repos/huggingface/datasets/issues/comments/1321174723/reactions
2022-11-20T16:27:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1321174723
https://avatars.githubusercontent.com/u/67118602?v=4
https://api.github.com/users/QuantumStatic/events{/privacy}
https://api.github.com/users/QuantumStatic/followers
https://api.github.com/users/QuantumStatic/following{/other_user}
https://api.github.com/users/QuantumStatic/gists{/gist_id}
https://github.com/QuantumStatic
QuantumStatic
MDQ6VXNlcjY3MTE4NjAy
https://api.github.com/users/QuantumStatic/orgs
https://api.github.com/users/QuantumStatic/received_events
https://api.github.com/users/QuantumStatic/repos
https://api.github.com/users/QuantumStatic/starred{/owner}{/repo}
https://api.github.com/users/QuantumStatic/subscriptions
User
https://api.github.com/users/QuantumStatic
public
NONE
> `ds = load_dataset("csv", data_files={'train': 'train.csv', 'test': 'test.csv'})`
> 
> Gives the output `Using custom data configuration default-5c8ae7c208631aca`
> 
> and the code hangs there.

Have you solved it? I met this problem too!
2022-11-21T14:58:11Z
https://github.com/huggingface/datasets/issues/730#issuecomment-1322191421
https://api.github.com/repos/huggingface/datasets/issues/730
IC_kwDODunzps5Ozwo9
https://api.github.com/repos/huggingface/datasets/issues/comments/1322191421/reactions
2022-11-21T14:58:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1322191421
https://avatars.githubusercontent.com/u/58108746?v=4
https://api.github.com/users/ShaohanTian/events{/privacy}
https://api.github.com/users/ShaohanTian/followers
https://api.github.com/users/ShaohanTian/following{/other_user}
https://api.github.com/users/ShaohanTian/gists{/gist_id}
https://github.com/ShaohanTian
ShaohanTian
MDQ6VXNlcjU4MTA4NzQ2
https://api.github.com/users/ShaohanTian/orgs
https://api.github.com/users/ShaohanTian/received_events
https://api.github.com/users/ShaohanTian/repos
https://api.github.com/users/ShaohanTian/starred{/owner}{/repo}
https://api.github.com/users/ShaohanTian/subscriptions
User
https://api.github.com/users/ShaohanTian
public
MEMBER
Can you Ctrl+C to kill the process and share the stacktrace here ? It should show at which location in the code it was hanging
2022-11-21T15:21:31Z
https://github.com/huggingface/datasets/issues/730#issuecomment-1322225682
https://api.github.com/repos/huggingface/datasets/issues/730
IC_kwDODunzps5Oz5AS
https://api.github.com/repos/huggingface/datasets/issues/comments/1322225682/reactions
2022-11-21T15:21:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1322225682
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
I had the same issue and solved it by downgrading the datasets version from 2.7.0 -> 2.6.1
pip install -q datasets==2.6.1
2022-11-21T21:05:15Z
https://github.com/huggingface/datasets/issues/730#issuecomment-1322639681
https://api.github.com/repos/huggingface/datasets/issues/730
IC_kwDODunzps5O1eFB
https://api.github.com/repos/huggingface/datasets/issues/comments/1322639681/reactions
2022-11-21T21:05:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1322639681
https://avatars.githubusercontent.com/u/6943458?v=4
https://api.github.com/users/ChrissSlow/events{/privacy}
https://api.github.com/users/ChrissSlow/followers
https://api.github.com/users/ChrissSlow/following{/other_user}
https://api.github.com/users/ChrissSlow/gists{/gist_id}
https://github.com/ChrissSlow
ChrissSlow
MDQ6VXNlcjY5NDM0NTg=
https://api.github.com/users/ChrissSlow/orgs
https://api.github.com/users/ChrissSlow/received_events
https://api.github.com/users/ChrissSlow/repos
https://api.github.com/users/ChrissSlow/starred{/owner}{/repo}
https://api.github.com/users/ChrissSlow/subscriptions
User
https://api.github.com/users/ChrissSlow
public
NONE
> I had the same issue and solved it by downgrading the datasets version from 2.7.0 -> 2.6.1 pip install -q datasets==2.6.1

Thanks, it works for me
2022-11-22T01:45:54Z
https://github.com/huggingface/datasets/issues/730#issuecomment-1322895445
https://api.github.com/repos/huggingface/datasets/issues/730
IC_kwDODunzps5O2chV
https://api.github.com/repos/huggingface/datasets/issues/comments/1322895445/reactions
2022-11-22T01:45:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1322895445
https://avatars.githubusercontent.com/u/58108746?v=4
https://api.github.com/users/ShaohanTian/events{/privacy}
https://api.github.com/users/ShaohanTian/followers
https://api.github.com/users/ShaohanTian/following{/other_user}
https://api.github.com/users/ShaohanTian/gists{/gist_id}
https://github.com/ShaohanTian
ShaohanTian
MDQ6VXNlcjU4MTA4NzQ2
https://api.github.com/users/ShaohanTian/orgs
https://api.github.com/users/ShaohanTian/received_events
https://api.github.com/users/ShaohanTian/repos
https://api.github.com/users/ShaohanTian/starred{/owner}{/repo}
https://api.github.com/users/ShaohanTian/subscriptions
User
https://api.github.com/users/ShaohanTian
public
The following code with `test1.txt` containing just "🤗🤗🤗":
```
dataset = datasets.load_dataset('text', data_files=['test1.txt'], split="train", encoding="latin_1")
print(dataset[0])
dataset = datasets.load_dataset('text', data_files=['test1.txt'], split="train", encoding="utf-8")
print(dataset[0])
``` 
produces this output:
```
Downloading and preparing dataset text/default-15600e4d83254059 (download: Unknown size, generated: Unknown size, post-processed: Unknown size, total: Unknown size) to /home/arne/.cache/huggingface/datasets/text/default-15600e4d83254059/0.0.0/52cefbb2b82b015d4253f1aeb1e6ee5591124a6491e834acfe1751f765925155...
Dataset text downloaded and prepared to /home/arne/.cache/huggingface/datasets/text/default-15600e4d83254059/0.0.0/52cefbb2b82b015d4253f1aeb1e6ee5591124a6491e834acfe1751f765925155. Subsequent calls will reuse this data.
{'text': 'ð\x9f¤\x97ð\x9f¤\x97ð\x9f¤\x97'}
Using custom data configuration default
Reusing dataset text (/home/arne/.cache/huggingface/datasets/text/default-15600e4d83254059/0.0.0/52cefbb2b82b015d4253f1aeb1e6ee5591124a6491e834acfe1751f765925155)
{'text': 'ð\x9f¤\x97ð\x9f¤\x97ð\x9f¤\x97'}
```
Just changing the order (and deleting the temp files):
```
dataset = datasets.load_dataset('text', data_files=['test1.txt'], split="train", encoding="utf-8")
print(dataset[0])
dataset = datasets.load_dataset('text', data_files=['test1.txt'], split="train", encoding="latin_1")
print(dataset[0])
```
produces this:
```
Using custom data configuration default
Downloading and preparing dataset text/default-15600e4d83254059 (download: Unknown size, generated: Unknown size, post-processed: Unknown size, total: Unknown size) to /home/arne/.cache/huggingface/datasets/text/default-15600e4d83254059/0.0.0/52cefbb2b82b015d4253f1aeb1e6ee5591124a6491e834acfe1751f765925155...
Dataset text downloaded and prepared to /home/arne/.cache/huggingface/datasets/text/default-15600e4d83254059/0.0.0/52cefbb2b82b015d4253f1aeb1e6ee5591124a6491e834acfe1751f765925155. Subsequent calls will reuse this data.
{'text': '🤗🤗🤗'}
Using custom data configuration default
Reusing dataset text (/home/arne/.cache/huggingface/datasets/text/default-15600e4d83254059/0.0.0/52cefbb2b82b015d4253f1aeb1e6ee5591124a6491e834acfe1751f765925155)
{'text': '🤗🤗🤗'}
```

Is it intended that the cache path does not depend on the config entries?

tested with datasets==1.1.2 and python==3.8.5