Add doc builder scripts
MEMBER
I think we're only missing the hosted runner to be configured for this repository and we should be good
2022-02-25T16:51:07Z
https://github.com/huggingface/datasets/pull/3790#issuecomment-1051020617
https://api.github.com/repos/huggingface/datasets/issues/3790
IC_kwDODunzps4-pU1J
https://api.github.com/repos/huggingface/datasets/issues/comments/1051020617/reactions
2022-02-25T16:51:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1051020617
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Regarding the self-hosted runner, I actually encourage using the approach defined here: https://github.com/huggingface/transformers/pull/15710, which doesn't leverage a self-hosted runner. This prevents queuing jobs, which is important when we expect several concurrent jobs.
2022-02-25T23:00:02Z
https://github.com/huggingface/datasets/pull/3790#issuecomment-1051340254
https://api.github.com/repos/huggingface/datasets/issues/3790
IC_kwDODunzps4-qi3e
https://api.github.com/repos/huggingface/datasets/issues/comments/1051340254/reactions
2022-02-25T23:00:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1051340254
https://avatars.githubusercontent.com/u/30755778?v=4
https://api.github.com/users/LysandreJik/events{/privacy}
https://api.github.com/users/LysandreJik/followers
https://api.github.com/users/LysandreJik/following{/other_user}
https://api.github.com/users/LysandreJik/gists{/gist_id}
https://github.com/LysandreJik
LysandreJik
MDQ6VXNlcjMwNzU1Nzc4
https://api.github.com/users/LysandreJik/orgs
https://api.github.com/users/LysandreJik/received_events
https://api.github.com/users/LysandreJik/repos
https://api.github.com/users/LysandreJik/starred{/owner}{/repo}
https://api.github.com/users/LysandreJik/subscriptions
User
https://api.github.com/users/LysandreJik
public
MEMBER
Opened a PR for that on your branch here: https://github.com/huggingface/datasets/pull/3793
2022-02-25T23:49:57Z
https://github.com/huggingface/datasets/pull/3790#issuecomment-1051372906
https://api.github.com/repos/huggingface/datasets/issues/3790
IC_kwDODunzps4-qq1q
https://api.github.com/repos/huggingface/datasets/issues/comments/1051372906/reactions
2022-02-25T23:49:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1051372906
https://avatars.githubusercontent.com/u/30755778?v=4
https://api.github.com/users/LysandreJik/events{/privacy}
https://api.github.com/users/LysandreJik/followers
https://api.github.com/users/LysandreJik/following{/other_user}
https://api.github.com/users/LysandreJik/gists{/gist_id}
https://github.com/LysandreJik
LysandreJik
MDQ6VXNlcjMwNzU1Nzc4
https://api.github.com/users/LysandreJik/orgs
https://api.github.com/users/LysandreJik/received_events
https://api.github.com/users/LysandreJik/repos
https://api.github.com/users/LysandreJik/starred{/owner}{/repo}
https://api.github.com/users/LysandreJik/subscriptions
User
https://api.github.com/users/LysandreJik
public
I added the three scripts:
- build_dev_documentation.yml
- build_documentation.yml
- delete_dev_documentation.yml

I got them from `transformers` and did a few changes:
- I removed the `transformers`-specific dependencies
- I changed all the paths to be "datasets" instead of "transformers"
- I passed the `--library_name datasets` arg to the `doc-builder build` command (according to https://github.com/huggingface/doc-builder/pull/94/files#diff-bcc33cf7c223511e498776684a9a433810b527a0a38f483b1487e8a42b6575d3R26)

cc @LysandreJik @mishig25 