Unable to resolve any data file after loading once
MEMBER
Hi ! `load_dataset` accepts as input either a local dataset directory or a dataset name from the Hugging Face Hub.

So here you are getting this error the second time because it tries to load the local `wiki_dpr` directory, instead of `wiki_dpr` from the Hub. It doesn't work since it's a **cache** directory, not a **dataset** directory in itself.

To fix that you can use another cache directory like `cache_dir="/data2/whr/lzy/open_domain_data/retrieval/cache"`
2021-12-21T10:41:38Z
https://github.com/huggingface/datasets/issues/3431#issuecomment-998670364
https://api.github.com/repos/huggingface/datasets/issues/3431
IC_kwDODunzps47hoAc
https://api.github.com/repos/huggingface/datasets/issues/comments/998670364/reactions
2021-12-21T10:41:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/998670364
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
thx a lot
2021-12-21T11:02:06Z
https://github.com/huggingface/datasets/issues/3431#issuecomment-998684020
https://api.github.com/repos/huggingface/datasets/issues/3431
IC_kwDODunzps47hrV0
https://api.github.com/repos/huggingface/datasets/issues/comments/998684020/reactions
2021-12-21T11:02:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/998684020
https://avatars.githubusercontent.com/u/84694183?v=4
https://api.github.com/users/LzyFischer/events{/privacy}
https://api.github.com/users/LzyFischer/followers
https://api.github.com/users/LzyFischer/following{/other_user}
https://api.github.com/users/LzyFischer/gists{/gist_id}
https://github.com/LzyFischer
LzyFischer
MDQ6VXNlcjg0Njk0MTgz
https://api.github.com/users/LzyFischer/orgs
https://api.github.com/users/LzyFischer/received_events
https://api.github.com/users/LzyFischer/repos
https://api.github.com/users/LzyFischer/starred{/owner}{/repo}
https://api.github.com/users/LzyFischer/subscriptions
User
https://api.github.com/users/LzyFischer
public
when I rerun my program, it occurs this error
" Unable to resolve any data file that matches '['**train*']' at /data2/whr/lzy/open_domain_data/retrieval/wiki_dpr with any supported extension ['csv', 'tsv', 'json', 'jsonl', 'parquet', 'txt', 'zip']", so how could i deal with this problem?
thx.
And below is my code .
![image](https://user-images.githubusercontent.com/84694183/146023446-d75fdec8-65c1-484f-80d8-6c20ff5e994b.png)
