Doc: save_to_disk, `num_proc` will affect `num_shards`, but it's not documented
COLLABORATOR
I agree this should be documented
2023-03-21T13:13:18Z
https://github.com/huggingface/datasets/issues/5653#issuecomment-1477816577
https://api.github.com/repos/huggingface/datasets/issues/5653
IC_kwDODunzps5YFbEB
https://api.github.com/repos/huggingface/datasets/issues/comments/1477816577/reactions
2023-03-21T13:13:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1477816577
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
### Describe the bug

[`num_proc`](https://huggingface.co/docs/datasets/main/en/package_reference/main_classes#datasets.DatasetDict.save_to_disk.num_proc) will affect `num_shards`, but it's not documented


### Steps to reproduce the bug

Nothing to reproduce

### Expected behavior

[document of `num_shards`](https://huggingface.co/docs/datasets/main/en/package_reference/main_classes#datasets.DatasetDict.save_to_disk.num_shards) explicitly says that it depends on `max_shard_size`, it should also mention `num_proc`.


### Environment info

datasets main document