Update local loading script docs
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_4778). All of your documentation changes will be reflected on that endpoint.
2022-08-01T20:27:45Z
https://github.com/huggingface/datasets/pull/4778#issuecomment-1201678894
https://api.github.com/repos/huggingface/datasets/issues/4778
IC_kwDODunzps5HoCou
https://api.github.com/repos/huggingface/datasets/issues/comments/1201678894/reactions
2022-08-01T20:27:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1201678894
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
COLLABORATOR
I would rather have a section in the docs that explains how to modify the script of an existing dataset (`inspect_dataset` + modification + `load_dataset`) instead of focusing on the GH datasets bundled with the source (only applicable for devs).
2022-08-10T11:10:14Z
https://github.com/huggingface/datasets/pull/4778#issuecomment-1210524073
https://api.github.com/repos/huggingface/datasets/issues/4778
IC_kwDODunzps5IJyGp
https://api.github.com/repos/huggingface/datasets/issues/comments/1210524073/reactions
2022-08-10T11:10:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1210524073
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
MEMBER
Good idea! I went with @mariosasko's suggestion to use `inspect_dataset` instead of cloning a dataset repository since it's a good opportunity to show off more of the library's lesser-known functions if that's ok with everyone :)
2022-08-18T17:47:29Z
https://github.com/huggingface/datasets/pull/4778#issuecomment-1219766708
https://api.github.com/repos/huggingface/datasets/issues/4778
IC_kwDODunzps5ItCm0
https://api.github.com/repos/huggingface/datasets/issues/comments/1219766708/reactions
2022-08-18T17:47:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1219766708
https://avatars.githubusercontent.com/u/59462357?v=4
https://api.github.com/users/stevhliu/events{/privacy}
https://api.github.com/users/stevhliu/followers
https://api.github.com/users/stevhliu/following{/other_user}
https://api.github.com/users/stevhliu/gists{/gist_id}
https://github.com/stevhliu
stevhliu
MDQ6VXNlcjU5NDYyMzU3
https://api.github.com/users/stevhliu/orgs
https://api.github.com/users/stevhliu/received_events
https://api.github.com/users/stevhliu/repos
https://api.github.com/users/stevhliu/starred{/owner}{/repo}
https://api.github.com/users/stevhliu/subscriptions
User
https://api.github.com/users/stevhliu
public
COLLABORATOR
One advantage of cloning the repo is that it fetches potential data files referenced inside a script using relative paths, so if we decide to use `inspect_dataset`, we should at least add a tip to explain this limitation and how to circumvent it.
2022-08-19T13:36:42Z
https://github.com/huggingface/datasets/pull/4778#issuecomment-1220693009
https://api.github.com/repos/huggingface/datasets/issues/4778
IC_kwDODunzps5IwkwR
https://api.github.com/repos/huggingface/datasets/issues/comments/1220693009/reactions
2022-08-19T13:36:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1220693009
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
MEMBER
Oh you're right. Calling `load_dataset` on the modified script without having the files that come with it is not ideal. I agree it should be `git clone` instead - and inspect is for inspection only ^^'
2022-08-19T13:40:52Z
https://github.com/huggingface/datasets/pull/4778#issuecomment-1220697715
https://api.github.com/repos/huggingface/datasets/issues/4778
IC_kwDODunzps5Iwl5z
https://api.github.com/repos/huggingface/datasets/issues/comments/1220697715/reactions
2022-08-19T13:40:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1220697715
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
This PR clarifies the local loading script section to include how to load a dataset after you've modified the local loading script (closes #4732).