data_args.preprocessing_num_workers almost freezes 
NONE
Hi.
I cannot always reproduce this issue, and on later runs I did not see it so far. Sometimes also I set 8 processes but I see less being showed, is this normal, here only 5 are shown for 8 being set, thanks

```
#3:  11%|███████████████▊                                                                                                                                  | 172/1583 [00:46<06:21,  3.70ba/s]
#4:   9%|█████████████▏                                                                                                                                    | 143/1583 [00:46<07:46,  3.09ba/s]
#7:   6%|█████████                                                                                                                                          | 98/1583 [00:45<11:34,  2.14ba/s]
#5:   8%|███████████▍                                                                                                                                      | 124/1583 [00:46<09:03,  2.68ba/s]
#6:   7%|██████████▏  
```
2021-04-02T09:22:06Z
https://github.com/huggingface/datasets/issues/2160#issuecomment-812449131
https://api.github.com/repos/huggingface/datasets/issues/2160
MDEyOklzc3VlQ29tbWVudDgxMjQ0OTEzMQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/812449131/reactions
2021-04-02T10:02:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/812449131
https://avatars.githubusercontent.com/u/79165106?v=4
https://api.github.com/users/dorost1234/events{/privacy}
https://api.github.com/users/dorost1234/followers
https://api.github.com/users/dorost1234/following{/other_user}
https://api.github.com/users/dorost1234/gists{/gist_id}
https://github.com/dorost1234
dorost1234
MDQ6VXNlcjc5MTY1MTA2
https://api.github.com/users/dorost1234/orgs
https://api.github.com/users/dorost1234/received_events
https://api.github.com/users/dorost1234/repos
https://api.github.com/users/dorost1234/starred{/owner}{/repo}
https://api.github.com/users/dorost1234/subscriptions
User
https://api.github.com/users/dorost1234
public
NONE
closing since I cannot reproduce it again, thanks 
2021-04-02T10:14:31Z
https://github.com/huggingface/datasets/issues/2160#issuecomment-812467943
https://api.github.com/repos/huggingface/datasets/issues/2160
MDEyOklzc3VlQ29tbWVudDgxMjQ2Nzk0Mw==
https://api.github.com/repos/huggingface/datasets/issues/comments/812467943/reactions
2021-04-02T10:14:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/812467943
https://avatars.githubusercontent.com/u/79165106?v=4
https://api.github.com/users/dorost1234/events{/privacy}
https://api.github.com/users/dorost1234/followers
https://api.github.com/users/dorost1234/following{/other_user}
https://api.github.com/users/dorost1234/gists{/gist_id}
https://github.com/dorost1234
dorost1234
MDQ6VXNlcjc5MTY1MTA2
https://api.github.com/users/dorost1234/orgs
https://api.github.com/users/dorost1234/received_events
https://api.github.com/users/dorost1234/repos
https://api.github.com/users/dorost1234/starred{/owner}{/repo}
https://api.github.com/users/dorost1234/subscriptions
User
https://api.github.com/users/dorost1234
public
Hi @lhoestq 

I am running this code from huggingface transformers https://github.com/huggingface/transformers/blob/master/examples/language-modeling/run_mlm.py 

to speed up tokenization, since I am running on multiple datasets, I am using data_args.preprocessing_num_workers = 4 with opus100 corpus but this moves on till a point and then this freezes almost for sometime during  tokenization steps and then this is back again, overall to me taking more time than normal case, I appreciate your advice on how I can use this option properly to speed up.

thanks