the_pile datasets URL broken. 
MEMBER
Thanks for reporting, @TrentBrick. We are addressing the change with their data host server.

On the meantime, if you would like to work with your fixed local copy of the_pile script, you should use:
```python
load_dataset("path/to/your/local/the_pile/the_pile.py",...
```
instead of just `load_dataset("the_pile",...`.

The latter downloads a copy of `the_pile.py` from our GitHub, caches it locally (inside `~/.cache/huggingface/modules`) and uses that.
2022-07-21T05:00:26Z
https://github.com/huggingface/datasets/issues/4725#issuecomment-1191040245
https://api.github.com/repos/huggingface/datasets/issues/4725
IC_kwDODunzps5G_dT1
https://api.github.com/repos/huggingface/datasets/issues/comments/1191040245/reactions
2022-07-21T05:03:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1191040245
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
@TrentBrick, I have checked the URLs and both hosts work, the original (https://the-eye.eu/) and the mirror (https://mystic.the-eye.eu/). See e.g.:
- https://mystic.the-eye.eu/public/AI/pile/
- https://mystic.the-eye.eu/public/AI/pile_preliminary_components/

Please, let me know if you still find any issue loading this dataset by using current server URLs.
2022-07-21T07:38:19Z
https://github.com/huggingface/datasets/issues/4725#issuecomment-1191150361
https://api.github.com/repos/huggingface/datasets/issues/4725
IC_kwDODunzps5G_4MZ
https://api.github.com/repos/huggingface/datasets/issues/comments/1191150361/reactions
2022-07-21T07:39:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1191150361
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Great this is working now. Re the download from GitHub... I'm sure thought went into doing this but could it be made more clear maybe here? https://huggingface.co/docs/datasets/installation for example under installing from source? I spent over an hour questioning my sanity as I kept trying to edit this file, uninstall and reinstall the repo, git reset to previous versions of the file etc.
2022-07-21T19:33:40Z
https://github.com/huggingface/datasets/issues/4725#issuecomment-1191858596
https://api.github.com/repos/huggingface/datasets/issues/4725
IC_kwDODunzps5HClGk
https://api.github.com/repos/huggingface/datasets/issues/comments/1191858596/reactions
2022-07-21T19:33:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1191858596
https://avatars.githubusercontent.com/u/12433427?v=4
https://api.github.com/users/TrentBrick/events{/privacy}
https://api.github.com/users/TrentBrick/followers
https://api.github.com/users/TrentBrick/following{/other_user}
https://api.github.com/users/TrentBrick/gists{/gist_id}
https://github.com/TrentBrick
TrentBrick
MDQ6VXNlcjEyNDMzNDI3
https://api.github.com/users/TrentBrick/orgs
https://api.github.com/users/TrentBrick/received_events
https://api.github.com/users/TrentBrick/repos
https://api.github.com/users/TrentBrick/starred{/owner}{/repo}
https://api.github.com/users/TrentBrick/subscriptions
User
https://api.github.com/users/TrentBrick
public
NONE
Thanks for the quick reply and help too

2022-07-21T19:33:56Z
https://github.com/huggingface/datasets/issues/4725#issuecomment-1191858812
https://api.github.com/repos/huggingface/datasets/issues/4725
IC_kwDODunzps5HClJ8
https://api.github.com/repos/huggingface/datasets/issues/comments/1191858812/reactions
2022-07-21T19:33:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1191858812
https://avatars.githubusercontent.com/u/12433427?v=4
https://api.github.com/users/TrentBrick/events{/privacy}
https://api.github.com/users/TrentBrick/followers
https://api.github.com/users/TrentBrick/following{/other_user}
https://api.github.com/users/TrentBrick/gists{/gist_id}
https://github.com/TrentBrick
TrentBrick
MDQ6VXNlcjEyNDMzNDI3
https://api.github.com/users/TrentBrick/orgs
https://api.github.com/users/TrentBrick/received_events
https://api.github.com/users/TrentBrick/repos
https://api.github.com/users/TrentBrick/starred{/owner}{/repo}
https://api.github.com/users/TrentBrick/subscriptions
User
https://api.github.com/users/TrentBrick
public
MEMBER
Thanks @TrentBrick for the suggestion about improving our docs: we should definitely do this if you find they are not clear enough.

Currently, our docs explain how to load a dataset from a local loading script here: [Load > Local loading script](https://huggingface.co/docs/datasets/loading#local-loading-script)

I've opened an issue here:
- #4732

Feel free to comment on it any additional explanation/suggestion/requirement related to this problem.
2022-07-22T06:08:04Z
https://github.com/huggingface/datasets/issues/4725#issuecomment-1192218134
https://api.github.com/repos/huggingface/datasets/issues/4725
IC_kwDODunzps5HD84W
https://api.github.com/repos/huggingface/datasets/issues/comments/1192218134/reactions
2022-07-22T06:09:46Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1192218134
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
https://github.com/huggingface/datasets/pull/3627 changed the Eleuther AI Pile dataset URL from https://the-eye.eu/ to https://mystic.the-eye.eu/ but the latter is now broken and the former works again. 

Note that when I git clone the repo and use `pip install -e .` and then edit the URL back the codebase doesn't seem to use this edit so the mystic URL is also cached somewhere else that I can't find? 