Too much logging 
MEMBER
Hi ! Thanks for reporting :) 
I agree these one should be hidden when the logging level is warning, we'll fix that
2020-11-09T10:29:34Z
https://github.com/huggingface/datasets/issues/812#issuecomment-723922766
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDcyMzkyMjc2Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/723922766/reactions
2020-11-09T10:29:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/723922766
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
+1, the amount of logging is excessive.

Most of it indeed comes from `filelock.py`, though there are occasionally messages from other sources too. Below is an example (all of these messages were logged after I already called `datasets.logging.set_verbosity_error()`)

```
I1109 21:26:01.742688 139785006901056 filelock.py:318] Lock 139778216292192 released on /home/kitaev/.cache/huggingface/datasets/9ed4f2e133395826175a892c70611f68522c7bc61a35476e8b51a31afb76e4bf.e6f3e3f3e3875a07469d1cfd32e16e1d06b149616b11eef2d081c43d515b492d.py.lock
I1109 21:26:01.747898 139785006901056 filelock.py:274] Lock 139778216290176 acquired on /home/kitaev/.cache/huggingface/datasets/_home_kitaev_.cache_huggingface_datasets_glue_mnli_1.0.0_7c99657241149a24692c402a5c3f34d4c9f1df5ac2e4c3759fadea38f6cb29c4.lock
I1109 21:26:01.748258 139785006901056 filelock.py:318] Lock 139778216290176 released on /home/kitaev/.cache/huggingface/datasets/_home_kitaev_.cache_huggingface_datasets_glue_mnli_1.0.0_7c99657241149a24692c402a5c3f34d4c9f1df5ac2e4c3759fadea38f6cb29c4.lock
I1109 21:26:01.748412 139785006901056 filelock.py:274] Lock 139778215853024 acquired on /home/kitaev/.cache/huggingface/datasets/_home_kitaev_.cache_huggingface_datasets_glue_mnli_1.0.0_7c99657241149a24692c402a5c3f34d4c9f1df5ac2e4c3759fadea38f6cb29c4.lock
I1109 21:26:01.748497 139785006901056 filelock.py:318] Lock 139778215853024 released on /home/kitaev/.cache/huggingface/datasets/_home_kitaev_.cache_huggingface_datasets_glue_mnli_1.0.0_7c99657241149a24692c402a5c3f34d4c9f1df5ac2e4c3759fadea38f6cb29c4.lock
I1109 21:07:17.029001 140301730502464 filelock.py:274] Lock 140289479304360 acquired on /home/kitaev/.cache/huggingface/datasets/b16d3a04bf2cad1346896852bf120ba846ea1bebb1cd60255bb3a1a2bbcc3a67.ec871b06a00118091ec63eff0a641fddcb8d3c7cd52e855bbb2be28944df4b82.py.lock
I1109 21:07:17.029341 140301730502464 filelock.py:318] Lock 140289479304360 released on /home/kitaev/.cache/huggingface/datasets/b16d3a04bf2cad1346896852bf120ba846ea1bebb1cd60255bb3a1a2bbcc3a67.ec871b06a00118091ec63eff0a641fddcb8d3c7cd52e855bbb2be28944df4b82.py.lock
I1109 21:07:17.058964 140301730502464 filelock.py:274] Lock 140251889388120 acquired on /home/kitaev/.cache/huggingface/metrics/glue/mnli/default_experiment-1-0.arrow.lock
I1109 21:07:17.060933 140301730502464 filelock.py:318] Lock 140251889388120 released on /home/kitaev/.cache/huggingface/metrics/glue/mnli/default_experiment-1-0.arrow.lock
I1109 21:07:17.061067 140301730502464 filelock.py:274] Lock 140296072521488 acquired on /home/kitaev/.cache/huggingface/metrics/glue/mnli/default_experiment-1-0.arrow.lock
I1109 21:07:17.069736 140301730502464 metric.py:400] Removing /home/kitaev/.cache/huggingface/metrics/glue/mnli/default_experiment-1-0.arrow
I1109 21:07:17.069949 140301730502464 filelock.py:318] Lock 140296072521488 released on /home/kitaev/.cache/huggingface/metrics/glue/mnli/default_experiment-1-0.arrow.lock
```
2020-11-09T21:34:00Z
https://github.com/huggingface/datasets/issues/812#issuecomment-724291839
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDcyNDI5MTgzOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/724291839/reactions
2020-11-09T21:34:00Z
https://api.github.com/repos/huggingface/datasets/issues/comments/724291839
https://avatars.githubusercontent.com/u/252225?v=4
https://api.github.com/users/nikitakit/events{/privacy}
https://api.github.com/users/nikitakit/followers
https://api.github.com/users/nikitakit/following{/other_user}
https://api.github.com/users/nikitakit/gists{/gist_id}
https://github.com/nikitakit
nikitakit
MDQ6VXNlcjI1MjIyNQ==
https://api.github.com/users/nikitakit/orgs
https://api.github.com/users/nikitakit/received_events
https://api.github.com/users/nikitakit/repos
https://api.github.com/users/nikitakit/starred{/owner}{/repo}
https://api.github.com/users/nikitakit/subscriptions
User
https://api.github.com/users/nikitakit
public
NONE
So how to solve this problem?
2021-01-26T14:21:02Z
https://github.com/huggingface/datasets/issues/812#issuecomment-767572556
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDc2NzU3MjU1Ng==
https://api.github.com/repos/huggingface/datasets/issues/comments/767572556/reactions
2021-01-26T14:21:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/767572556
https://avatars.githubusercontent.com/u/21965264?v=4
https://api.github.com/users/agi-templar/events{/privacy}
https://api.github.com/users/agi-templar/followers
https://api.github.com/users/agi-templar/following{/other_user}
https://api.github.com/users/agi-templar/gists{/gist_id}
https://github.com/agi-templar
agi-templar
MDQ6VXNlcjIxOTY1MjY0
https://api.github.com/users/agi-templar/orgs
https://api.github.com/users/agi-templar/received_events
https://api.github.com/users/agi-templar/repos
https://api.github.com/users/agi-templar/starred{/owner}{/repo}
https://api.github.com/users/agi-templar/subscriptions
User
https://api.github.com/users/agi-templar
public
MEMBER
In the latest version of the lib the logs about locks are at the DEBUG level so you won't see them by default.
Also `set_verbosity_warning` does take into account these logs now.
Can you try to update the lib ?
```
pip install --upgrade datasets
```
2021-01-26T14:23:50Z
https://github.com/huggingface/datasets/issues/812#issuecomment-767574285
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDc2NzU3NDI4NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/767574285/reactions
2021-01-26T14:24:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/767574285
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Thanks. For some reason I have to use the older version. Is that possible I can fix this by some surface-level trick?

I'm still using 1.13 version datasets.
2021-01-26T14:26:20Z
https://github.com/huggingface/datasets/issues/812#issuecomment-767576097
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDc2NzU3NjA5Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/767576097/reactions
2021-01-26T14:26:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/767576097
https://avatars.githubusercontent.com/u/21965264?v=4
https://api.github.com/users/agi-templar/events{/privacy}
https://api.github.com/users/agi-templar/followers
https://api.github.com/users/agi-templar/following{/other_user}
https://api.github.com/users/agi-templar/gists{/gist_id}
https://github.com/agi-templar
agi-templar
MDQ6VXNlcjIxOTY1MjY0
https://api.github.com/users/agi-templar/orgs
https://api.github.com/users/agi-templar/received_events
https://api.github.com/users/agi-templar/repos
https://api.github.com/users/agi-templar/starred{/owner}{/repo}
https://api.github.com/users/agi-templar/subscriptions
User
https://api.github.com/users/agi-templar
public
MEMBER
On older versions you can use
```python
import logging

logging.getLogger("filelock").setLevel(logging.WARNING)
```
2021-01-26T14:30:21Z
https://github.com/huggingface/datasets/issues/812#issuecomment-767578736
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDc2NzU3ODczNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/767578736/reactions
2021-01-26T14:30:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/767578736
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Whoa Thank you! It works!
2021-01-26T14:31:34Z
https://github.com/huggingface/datasets/issues/812#issuecomment-767579585
https://api.github.com/repos/huggingface/datasets/issues/812
MDEyOklzc3VlQ29tbWVudDc2NzU3OTU4NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/767579585/reactions
2021-01-26T14:31:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/767579585
https://avatars.githubusercontent.com/u/21965264?v=4
https://api.github.com/users/agi-templar/events{/privacy}
https://api.github.com/users/agi-templar/followers
https://api.github.com/users/agi-templar/following{/other_user}
https://api.github.com/users/agi-templar/gists{/gist_id}
https://github.com/agi-templar
agi-templar
MDQ6VXNlcjIxOTY1MjY0
https://api.github.com/users/agi-templar/orgs
https://api.github.com/users/agi-templar/received_events
https://api.github.com/users/agi-templar/repos
https://api.github.com/users/agi-templar/starred{/owner}{/repo}
https://api.github.com/users/agi-templar/subscriptions
User
https://api.github.com/users/agi-templar
public
I'm doing this in the beginning of my script:

from datasets.utils import logging as datasets_logging
datasets_logging.set_verbosity_warning()

but I'm still getting these logs:

[2020-11-07 15:45:41,908][filelock][INFO] - Lock 139958278886176 acquired on /home/username/.cache/huggingface/datasets/cfe20ffaa80ef1c145a0a210d5b9cdce2b60002831e6ed0edc7ab9275d6f0d48.1bd4ccbce9de3dad0698d84674a19d6cc66a84db736a6398110bd196795dde7e.py.lock

[2020-11-07 15:45:41,909][filelock][INFO] - Lock 139958278886176 released on /home/username/.cache/huggingface/datasets/cfe20ffaa80ef1c145a0a210d5b9cdce2b60002831e6ed0edc7ab9275d6f0d48.1bd4ccbce9de3dad0698d84674a19d6cc66a84db736a6398110bd196795dde7e.py.lock

using datasets version = 1.1.2