feat: 🎸 generate info if dataset_infos.json does not exist
COLLABORATOR
It's a first attempt at solving https://github.com/huggingface/datasets/issues/3013.
2022-02-02T22:12:32Z
https://github.com/huggingface/datasets/pull/3670#issuecomment-1028406828
https://api.github.com/repos/huggingface/datasets/issues/3670
IC_kwDODunzps49TD4s
https://api.github.com/repos/huggingface/datasets/issues/comments/1028406828/reactions
2022-02-02T22:12:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1028406828
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
MEMBER
I only kept these ones:
```
    path: str,
    data_files: Optional[Union[Dict, List, str]] = None,
    download_config: Optional[DownloadConfig] = None,
    download_mode: Optional[GenerateMode] = None,
    revision: Optional[Union[str, Version]] = None,
    use_auth_token: Optional[Union[bool, str]] = None,
    **config_kwargs,
```

Let me know if it's better for you now !

(note that there's no breaking change since the ones that are removed can be passed as config_kwargs if you really want)
2022-02-11T19:59:07Z
https://github.com/huggingface/datasets/pull/3670#issuecomment-1036572008
https://api.github.com/repos/huggingface/datasets/issues/3670
IC_kwDODunzps49yNVo
https://api.github.com/repos/huggingface/datasets/issues/comments/1036572008/reactions
2022-02-11T19:59:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1036572008
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
COLLABORATOR
(https://github.com/huggingface/datasets/pull/3670/commits/5636911880ea4306c27c7f5825fa3f9427ccc2b6 and https://github.com/huggingface/datasets/pull/3670/commits/07c3f0800dd34dfebb9674ad46c67a907b08ded8 -> I has forgotten to update black in my venv)
2022-02-16T14:51:20Z
https://github.com/huggingface/datasets/pull/3670#issuecomment-1041572404
https://api.github.com/repos/huggingface/datasets/issues/3670
IC_kwDODunzps4-FSI0
https://api.github.com/repos/huggingface/datasets/issues/comments/1041572404/reactions
2022-02-16T14:51:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1041572404
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
in get_dataset_infos(). Also: add the `use_auth_token` parameter, and create get_dataset_config_info()

✅ Closes: #3013