[zstd] Use max window log size
NONE
@albertvillanova Please take a review.
2022-11-03T13:36:56Z
https://github.com/huggingface/datasets/pull/5197#issuecomment-1302127534
https://api.github.com/repos/huggingface/datasets/issues/5197
IC_kwDODunzps5NnOOu
https://api.github.com/repos/huggingface/datasets/issues/comments/1302127534/reactions
2022-11-03T13:36:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1302127534
https://avatars.githubusercontent.com/u/728699?v=4
https://api.github.com/users/reyoung/events{/privacy}
https://api.github.com/users/reyoung/followers
https://api.github.com/users/reyoung/following{/other_user}
https://api.github.com/users/reyoung/gists{/gist_id}
https://github.com/reyoung
reyoung
MDQ6VXNlcjcyODY5OQ==
https://api.github.com/users/reyoung/orgs
https://api.github.com/users/reyoung/received_events
https://api.github.com/users/reyoung/repos
https://api.github.com/users/reyoung/starred{/owner}{/repo}
https://api.github.com/users/reyoung/subscriptions
User
https://api.github.com/users/reyoung
public
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_5197). All of your documentation changes will be reflected on that endpoint.
2022-11-03T13:45:18Z
https://github.com/huggingface/datasets/pull/5197#issuecomment-1302138404
https://api.github.com/repos/huggingface/datasets/issues/5197
IC_kwDODunzps5NnQ4k
https://api.github.com/repos/huggingface/datasets/issues/comments/1302138404/reactions
2022-11-03T13:45:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1302138404
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
ZstdDecompressor has a parameter `max_window_size` to limit max memory usage when decompressing zstd files. The default `max_window_size` is not enough when files are compressed by `zstd --ultra` flags.

Change `max_window_size` to the zstd's max window size. NOTE, the `zstd.WINDOWLOG_MAX` is the log_2 value of the max window size.