Using `Dataset.map` with `n_proc>1` print multiple progress bars
MEMBER
Yes it allows to monitor the speed of each process. Currently each process takes care of one shard of the dataset.

At one point we can consider using streaming batches to a pool of processes instead of sharding the dataset in `num_proc` parts. At that point it will be easy to use only one progress bar
2020-10-28T14:18:17Z
https://github.com/huggingface/datasets/issues/771#issuecomment-717964079
https://api.github.com/repos/huggingface/datasets/issues/771
MDEyOklzc3VlQ29tbWVudDcxNzk2NDA3OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/717964079/reactions
2020-10-28T14:18:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/717964079
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hi @lhoestq, I am facing a similar issue, it is annoying when lots of progress bars are printed. Is there a way to turn off this behavior? 
2022-10-11T23:41:07Z
https://github.com/huggingface/datasets/issues/771#issuecomment-1275406187
https://api.github.com/repos/huggingface/datasets/issues/771
IC_kwDODunzps5MBSdr
https://api.github.com/repos/huggingface/datasets/issues/comments/1275406187/reactions
2022-10-11T23:41:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1275406187
https://avatars.githubusercontent.com/u/15224633?v=4
https://api.github.com/users/prateeky2806/events{/privacy}
https://api.github.com/users/prateeky2806/followers
https://api.github.com/users/prateeky2806/following{/other_user}
https://api.github.com/users/prateeky2806/gists{/gist_id}
https://github.com/prateeky2806
prateeky2806
MDQ6VXNlcjE1MjI0NjMz
https://api.github.com/users/prateeky2806/orgs
https://api.github.com/users/prateeky2806/received_events
https://api.github.com/users/prateeky2806/repos
https://api.github.com/users/prateeky2806/starred{/owner}{/repo}
https://api.github.com/users/prateeky2806/subscriptions
User
https://api.github.com/users/prateeky2806
public
MEMBER
You can disable the progress bars with
```python
import datasets

datasets.disable_progress_bar()
```
2022-10-12T09:53:07Z
https://github.com/huggingface/datasets/issues/771#issuecomment-1275899939
https://api.github.com/repos/huggingface/datasets/issues/771
IC_kwDODunzps5MDLAj
https://api.github.com/repos/huggingface/datasets/issues/comments/1275899939/reactions
2022-10-12T09:53:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1275899939
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
When using `Dataset.map` with `n_proc > 1`, only one of the processes should print a progress bar (to make the output readable). Right now, `n_proc` progress bars are printed.