`Dataset.map` disable progress bar
COLLABORATOR
Progress bar can be disabled like this:
```python
from datasets.utils.logging import set_verbosity_error
set_verbosity_error()
```

There is this line in `Dataset.map`:
```python
not_verbose = bool(logger.getEffectiveLevel() > WARNING)
```

So any logging level higher than `WARNING` turns off the progress bar.
2020-12-26T18:30:58Z
https://github.com/huggingface/datasets/issues/1627#issuecomment-751383559
https://api.github.com/repos/huggingface/datasets/issues/1627
MDEyOklzc3VlQ29tbWVudDc1MTM4MzU1OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/751383559/reactions
2020-12-26T18:30:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/751383559
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
From the linked issues above, an up-to-date solution is:

```python
from datasets.utils.logging import disable_progress_bar
disable_progress_bar()
```

https://github.com/huggingface/datasets/blob/c6e08fcfc3a04e53430c26fa7c07da4cb18d977d/src/datasets/utils/logging.py#L233-L236
2023-02-08T02:33:21Z
https://github.com/huggingface/datasets/issues/1627#issuecomment-1421893094
https://api.github.com/repos/huggingface/datasets/issues/1627
IC_kwDODunzps5UwF3m
https://api.github.com/repos/huggingface/datasets/issues/comments/1421893094/reactions
2023-02-08T02:37:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1421893094
https://avatars.githubusercontent.com/u/23152825?v=4
https://api.github.com/users/akeyhero/events{/privacy}
https://api.github.com/users/akeyhero/followers
https://api.github.com/users/akeyhero/following{/other_user}
https://api.github.com/users/akeyhero/gists{/gist_id}
https://github.com/akeyhero
akeyhero
MDQ6VXNlcjIzMTUyODI1
https://api.github.com/users/akeyhero/orgs
https://api.github.com/users/akeyhero/received_events
https://api.github.com/users/akeyhero/repos
https://api.github.com/users/akeyhero/starred{/owner}{/repo}
https://api.github.com/users/akeyhero/subscriptions
User
https://api.github.com/users/akeyhero
public
NONE
Why not have a parameter in the function such as `progress: bool = True`?
2024-05-23T17:28:02Z
https://github.com/huggingface/datasets/issues/1627#issuecomment-2127694920
https://api.github.com/repos/huggingface/datasets/issues/1627
IC_kwDODunzps5-0gxI
https://api.github.com/repos/huggingface/datasets/issues/comments/2127694920/reactions
2024-05-23T17:28:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2127694920
https://avatars.githubusercontent.com/u/4146799?v=4
https://api.github.com/users/brynhayder/events{/privacy}
https://api.github.com/users/brynhayder/followers
https://api.github.com/users/brynhayder/following{/other_user}
https://api.github.com/users/brynhayder/gists{/gist_id}
https://github.com/brynhayder
brynhayder
MDQ6VXNlcjQxNDY3OTk=
https://api.github.com/users/brynhayder/orgs
https://api.github.com/users/brynhayder/received_events
https://api.github.com/users/brynhayder/repos
https://api.github.com/users/brynhayder/starred{/owner}{/repo}
https://api.github.com/users/brynhayder/subscriptions
User
https://api.github.com/users/brynhayder
public
NONE
+1. We shouldn't need to play with logging levels for a simple thing like this. For instance, trainers have an option `show_progress` that does exactly this.
2025-03-31T18:20:55Z
https://github.com/huggingface/datasets/issues/1627#issuecomment-2767047039
https://api.github.com/repos/huggingface/datasets/issues/1627
IC_kwDODunzps6k7cl_
https://api.github.com/repos/huggingface/datasets/issues/comments/2767047039/reactions
2025-03-31T18:20:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2767047039
https://avatars.githubusercontent.com/u/20495460?v=4
https://api.github.com/users/ACMCMC/events{/privacy}
https://api.github.com/users/ACMCMC/followers
https://api.github.com/users/ACMCMC/following{/other_user}
https://api.github.com/users/ACMCMC/gists{/gist_id}
https://github.com/ACMCMC
ACMCMC
MDQ6VXNlcjIwNDk1NDYw
https://api.github.com/users/ACMCMC/orgs
https://api.github.com/users/ACMCMC/received_events
https://api.github.com/users/ACMCMC/repos
https://api.github.com/users/ACMCMC/starred{/owner}{/repo}
https://api.github.com/users/ACMCMC/subscriptions
User
https://api.github.com/users/ACMCMC
public
NONE
Bump on this, such a simple QOL issue why can't we fix this?
2025-05-16T16:36:23Z
https://github.com/huggingface/datasets/issues/1627#issuecomment-2887200049
https://api.github.com/repos/huggingface/datasets/issues/1627
IC_kwDODunzps6sFy0x
https://api.github.com/repos/huggingface/datasets/issues/comments/2887200049/reactions
2025-05-16T16:36:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2887200049
https://avatars.githubusercontent.com/u/202701550?v=4
https://api.github.com/users/pb-sameerreddy/events{/privacy}
https://api.github.com/users/pb-sameerreddy/followers
https://api.github.com/users/pb-sameerreddy/following{/other_user}
https://api.github.com/users/pb-sameerreddy/gists{/gist_id}
https://github.com/pb-sameerreddy
pb-sameerreddy
U_kgDODBT67g
https://api.github.com/users/pb-sameerreddy/orgs
https://api.github.com/users/pb-sameerreddy/received_events
https://api.github.com/users/pb-sameerreddy/repos
https://api.github.com/users/pb-sameerreddy/starred{/owner}{/repo}
https://api.github.com/users/pb-sameerreddy/subscriptions
User
https://api.github.com/users/pb-sameerreddy
public
I can't find anything to turn off the `tqdm` progress bars while running a preprocessing function using `Dataset.map`. I want to do akin to `disable_tqdm=True` in the case of `transformers`. Is there something like that?