Depracate `num_proc` parameter in `DownloadManager.extract`
NONE
I can take this! #self-assign
2022-10-20T01:17:11Z
https://github.com/huggingface/datasets/issues/5132#issuecomment-1284764406
https://api.github.com/repos/huggingface/datasets/issues/5132
IC_kwDODunzps5Mk_L2
https://api.github.com/repos/huggingface/datasets/issues/comments/1284764406/reactions
2022-10-20T01:17:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1284764406
https://avatars.githubusercontent.com/u/46943923?v=4
https://api.github.com/users/lazarust/events{/privacy}
https://api.github.com/users/lazarust/followers
https://api.github.com/users/lazarust/following{/other_user}
https://api.github.com/users/lazarust/gists{/gist_id}
https://github.com/lazarust
lazarust
MDQ6VXNlcjQ2OTQzOTIz
https://api.github.com/users/lazarust/orgs
https://api.github.com/users/lazarust/received_events
https://api.github.com/users/lazarust/repos
https://api.github.com/users/lazarust/starred{/owner}{/repo}
https://api.github.com/users/lazarust/subscriptions
User
https://api.github.com/users/lazarust
public
NONE
#self-assign
2022-10-20T01:18:45Z
https://github.com/huggingface/datasets/issues/5132#issuecomment-1284766004
https://api.github.com/repos/huggingface/datasets/issues/5132
IC_kwDODunzps5Mk_k0
https://api.github.com/repos/huggingface/datasets/issues/comments/1284766004/reactions
2022-10-20T01:18:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1284766004
https://avatars.githubusercontent.com/u/46943923?v=4
https://api.github.com/users/lazarust/events{/privacy}
https://api.github.com/users/lazarust/followers
https://api.github.com/users/lazarust/following{/other_user}
https://api.github.com/users/lazarust/gists{/gist_id}
https://github.com/lazarust
lazarust
MDQ6VXNlcjQ2OTQzOTIz
https://api.github.com/users/lazarust/orgs
https://api.github.com/users/lazarust/received_events
https://api.github.com/users/lazarust/repos
https://api.github.com/users/lazarust/starred{/owner}{/repo}
https://api.github.com/users/lazarust/subscriptions
User
https://api.github.com/users/lazarust
public
CONTRIBUTOR
@lazarust i'm already working on this issue :smile: 
2022-10-20T08:59:06Z
https://github.com/huggingface/datasets/issues/5132#issuecomment-1285179071
https://api.github.com/repos/huggingface/datasets/issues/5132
IC_kwDODunzps5Mmka_
https://api.github.com/repos/huggingface/datasets/issues/comments/1285179071/reactions
2022-10-20T08:59:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1285179071
https://avatars.githubusercontent.com/u/114604338?v=4
https://api.github.com/users/ayushthe1/events{/privacy}
https://api.github.com/users/ayushthe1/followers
https://api.github.com/users/ayushthe1/following{/other_user}
https://api.github.com/users/ayushthe1/gists{/gist_id}
https://github.com/ayushthe1
ayushthe1
U_kgDOBtS5Mg
https://api.github.com/users/ayushthe1/orgs
https://api.github.com/users/ayushthe1/received_events
https://api.github.com/users/ayushthe1/repos
https://api.github.com/users/ayushthe1/starred{/owner}{/repo}
https://api.github.com/users/ayushthe1/subscriptions
User
https://api.github.com/users/ayushthe1
public
CONTRIBUTOR
#self-assign
2022-10-20T09:15:58Z
https://github.com/huggingface/datasets/issues/5132#issuecomment-1285205068
https://api.github.com/repos/huggingface/datasets/issues/5132
IC_kwDODunzps5MmqxM
https://api.github.com/repos/huggingface/datasets/issues/comments/1285205068/reactions
2022-10-20T09:15:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1285205068
https://avatars.githubusercontent.com/u/114604338?v=4
https://api.github.com/users/ayushthe1/events{/privacy}
https://api.github.com/users/ayushthe1/followers
https://api.github.com/users/ayushthe1/following{/other_user}
https://api.github.com/users/ayushthe1/gists{/gist_id}
https://github.com/ayushthe1
ayushthe1
U_kgDOBtS5Mg
https://api.github.com/users/ayushthe1/orgs
https://api.github.com/users/ayushthe1/received_events
https://api.github.com/users/ayushthe1/repos
https://api.github.com/users/ayushthe1/starred{/owner}{/repo}
https://api.github.com/users/ayushthe1/subscriptions
User
https://api.github.com/users/ayushthe1
public
CONTRIBUTOR
hey @mariosasko , i made a pr for this issue. Could you please review it.
2022-10-20T09:54:05Z
https://github.com/huggingface/datasets/issues/5132#issuecomment-1285251692
https://api.github.com/repos/huggingface/datasets/issues/5132
IC_kwDODunzps5Mm2Js
https://api.github.com/repos/huggingface/datasets/issues/comments/1285251692/reactions
2022-10-20T09:54:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1285251692
https://avatars.githubusercontent.com/u/114604338?v=4
https://api.github.com/users/ayushthe1/events{/privacy}
https://api.github.com/users/ayushthe1/followers
https://api.github.com/users/ayushthe1/following{/other_user}
https://api.github.com/users/ayushthe1/gists{/gist_id}
https://github.com/ayushthe1
ayushthe1
U_kgDOBtS5Mg
https://api.github.com/users/ayushthe1/orgs
https://api.github.com/users/ayushthe1/received_events
https://api.github.com/users/ayushthe1/repos
https://api.github.com/users/ayushthe1/starred{/owner}{/repo}
https://api.github.com/users/ayushthe1/subscriptions
User
https://api.github.com/users/ayushthe1
public
The `num_proc` parameter is only present in `DownloadManager.extract` but not in `StreamingDownloadManager.extract`, making it impossible to support streaming in the dataset scripts that use it (`openwebtext` and `the_pile_stack_exchange`). We can avoid this situation by deprecating this parameter and passing `DownloadConfig`'s `num_proc` to `map_nested` instead, as it's done in `DownloadManager.download`.