Setting log level higher than warning does not suppress progress bar
COLLABORATOR
Hi,

you can suppress progress bars by patching logging as follows:
```python
import datasets
import logging
datasets.logging.get_verbosity = lambda: logging.NOTSET
# map call ...
```
EDIT: now you have to use `disable_progress_bar `
2021-07-14T23:15:15Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-880270774
https://api.github.com/repos/huggingface/datasets/issues/2651
MDEyOklzc3VlQ29tbWVudDg4MDI3MDc3NA==
https://api.github.com/repos/huggingface/datasets/issues/comments/880270774/reactions
2022-07-08T14:51:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/880270774
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
Thank you, it worked :)
2021-07-15T03:41:35Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-880367807
https://api.github.com/repos/huggingface/datasets/issues/2651
MDEyOklzc3VlQ29tbWVudDg4MDM2NzgwNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/880367807/reactions
2021-07-15T03:41:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/880367807
https://avatars.githubusercontent.com/u/1147443?v=4
https://api.github.com/users/Isa-rentacs/events{/privacy}
https://api.github.com/users/Isa-rentacs/followers
https://api.github.com/users/Isa-rentacs/following{/other_user}
https://api.github.com/users/Isa-rentacs/gists{/gist_id}
https://github.com/Isa-rentacs
Isa-rentacs
MDQ6VXNlcjExNDc0NDM=
https://api.github.com/users/Isa-rentacs/orgs
https://api.github.com/users/Isa-rentacs/received_events
https://api.github.com/users/Isa-rentacs/repos
https://api.github.com/users/Isa-rentacs/starred{/owner}{/repo}
https://api.github.com/users/Isa-rentacs/subscriptions
User
https://api.github.com/users/Isa-rentacs
public
COLLABORATOR
See https://github.com/huggingface/datasets/issues/2528 for reference
2021-07-23T12:54:25Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-885617353
https://api.github.com/repos/huggingface/datasets/issues/2651
IC_kwDODunzps40yXLJ
https://api.github.com/repos/huggingface/datasets/issues/comments/885617353/reactions
2021-07-23T12:54:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/885617353
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
COLLABORATOR
Note also that you can disable the progress bar with

```python
from datasets.utils import disable_progress_bar
disable_progress_bar()
```

See https://github.com/huggingface/datasets/blob/8814b393984c1c2e1800ba370de2a9f7c8644908/src/datasets/utils/tqdm_utils.py#L84
2021-07-23T13:03:10Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-885622620
https://api.github.com/repos/huggingface/datasets/issues/2651
IC_kwDODunzps40yYdc
https://api.github.com/repos/huggingface/datasets/issues/comments/885622620/reactions
2021-07-23T13:03:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/885622620
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
NONE
Now the library officially recommends `set_progress_bar_enabled(False)`

```py
from datasets.utils import set_progress_bar_enabled

set_progress_bar_enabled(False)
```

source:

https://github.com/huggingface/datasets/blob/1fd47120ace13626c528367787ffa13e1a26e6c0/src/datasets/utils/tqdm_utils.py#L83-L88


2021-12-15T01:59:24Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-994217405
https://api.github.com/repos/huggingface/datasets/issues/2651
IC_kwDODunzps47Qo29
https://api.github.com/repos/huggingface/datasets/issues/comments/994217405/reactions
2021-12-15T01:59:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/994217405
https://avatars.githubusercontent.com/u/36184621?v=4
https://api.github.com/users/kaisugi/events{/privacy}
https://api.github.com/users/kaisugi/followers
https://api.github.com/users/kaisugi/following{/other_user}
https://api.github.com/users/kaisugi/gists{/gist_id}
https://github.com/kaisugi
kaisugi
MDQ6VXNlcjM2MTg0NjIx
https://api.github.com/users/kaisugi/orgs
https://api.github.com/users/kaisugi/received_events
https://api.github.com/users/kaisugi/repos
https://api.github.com/users/kaisugi/starred{/owner}{/repo}
https://api.github.com/users/kaisugi/subscriptions
User
https://api.github.com/users/kaisugi
public
MEMBER
From https://github.com/huggingface/datasets/pull/3897, `disable_progress_bar` is the function you should use
2022-03-14T14:29:01Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-1066866605
https://api.github.com/repos/huggingface/datasets/issues/2651
IC_kwDODunzps4_lxet
https://api.github.com/repos/huggingface/datasets/issues/comments/1066866605/reactions
2022-03-14T14:29:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1066866605
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Now ``disable_progress_bar`` function is in ``datasets/src/datasets/utils/logging.py``.
https://github.com/huggingface/datasets/blob/aa555a299ad73c65e3f997a764e9d211675ab05d/src/datasets/utils/logging.py#L233-L236
And the method mentioned in https://github.com/huggingface/datasets/issues/2651#issuecomment-880270774 is not working now.
2022-06-28T11:15:04Z
https://github.com/huggingface/datasets/issues/2651#issuecomment-1168586609
https://api.github.com/repos/huggingface/datasets/issues/2651
IC_kwDODunzps5Fpzdx
https://api.github.com/repos/huggingface/datasets/issues/comments/1168586609/reactions
2022-06-28T11:15:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1168586609
https://avatars.githubusercontent.com/u/37944786?v=4
https://api.github.com/users/Raibows/events{/privacy}
https://api.github.com/users/Raibows/followers
https://api.github.com/users/Raibows/following{/other_user}
https://api.github.com/users/Raibows/gists{/gist_id}
https://github.com/Raibows
Raibows
MDQ6VXNlcjM3OTQ0Nzg2
https://api.github.com/users/Raibows/orgs
https://api.github.com/users/Raibows/received_events
https://api.github.com/users/Raibows/repos
https://api.github.com/users/Raibows/starred{/owner}{/repo}
https://api.github.com/users/Raibows/subscriptions
User
https://api.github.com/users/Raibows
public
## Describe the bug
I would like to disable progress bars for `.map` method (and other methods like `.filter` and `load_dataset` as well).
According to #1627 one can suppress it by setting log level higher than `warning`, however doing so doesn't suppress it with version 1.9.0.

I also tried to set `DATASETS_VERBOSITY` environment variable to `error` or `critical` but it also didn't work.

## Steps to reproduce the bug
```python
import datasets

from datasets.utils.logging import set_verbosity_error

set_verbosity_error()

def dummy_map(batch):
    return batch

common_voice_train = datasets.load_dataset("common_voice", "de", split="train")
common_voice_test = datasets.load_dataset("common_voice", "de", split="test")

common_voice_train.map(dummy_map)
```

## Expected results
- The progress bar for `.map` call won't be shown

## Actual results
- The progress bar for `.map` is still shown 

## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: 1.9.0
- Platform: Linux-5.4.0-1045-aws-x86_64-with-Ubuntu-18.04-bionic
- Python version: 3.7.5
- PyArrow version: 4.0.1
