Extend support for streaming datasets that use os.walk
COLLABORATOR
Nice. I'll update the dataset viewer once merged, and test on these four datasets
2021-12-24T08:32:36Z
https://github.com/huggingface/datasets/pull/3478#issuecomment-1000723212
https://api.github.com/repos/huggingface/datasets/issues/3478
IC_kwDODunzps47pdMM
https://api.github.com/repos/huggingface/datasets/issues/comments/1000723212/reactions
2021-12-24T08:32:36Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1000723212
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
This PR extends the support in streaming mode for datasets that use `os.walk`, by patching that function.

This PR adds support for streaming mode to datasets:
1. autshumato
1. code_x_glue_cd_code_to_text
1. code_x_glue_tc_nl_code_search_adv
1. nchlt

CC: @severo 