Fix extraction protocol inference from urls with params
MEMBER
merging since the windows error is just a CircleCI issue
2021-08-30T13:12:31Z
https://github.com/huggingface/datasets/pull/2843#issuecomment-908331376
https://api.github.com/repos/huggingface/datasets/issues/2843
IC_kwDODunzps42JAlw
https://api.github.com/repos/huggingface/datasets/issues/comments/908331376/reactions
2021-08-30T13:12:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/908331376
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
COLLABORATOR
It works, eg https://observablehq.com/@huggingface/datasets-preview-backend-client#{%22datasetId%22%3A%22discovery%22} and https://datasets-preview.huggingface.tech/rows?dataset=discovery&config=discovery&split=train
2021-08-30T16:14:40Z
https://github.com/huggingface/datasets/pull/2843#issuecomment-908476895
https://api.github.com/repos/huggingface/datasets/issues/2843
IC_kwDODunzps42JkHf
https://api.github.com/repos/huggingface/datasets/issues/comments/908476895/reactions
2021-08-30T16:14:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/908476895
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
MEMBER
Nice !
2021-08-30T17:11:49Z
https://github.com/huggingface/datasets/pull/2843#issuecomment-908523209
https://api.github.com/repos/huggingface/datasets/issues/2843
IC_kwDODunzps42JvbJ
https://api.github.com/repos/huggingface/datasets/issues/comments/908523209/reactions
2021-08-30T17:11:49Z
https://api.github.com/repos/huggingface/datasets/issues/comments/908523209
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Previously it was unable to infer the compression protocol for files at URLs like
```
https://foo.bar/train.json.gz?dl=1
```
because of the query parameters.

I fixed that, this should allow 10+ datasets to work in streaming mode:
```
  "discovery",
  "emotion",
  "grail_qa",
  "guardian_authorship",
  "pragmeval",
  "simple_questions_v2",
  "versae/adobo",
  "w-nicole/childes_data",
  "w-nicole/childes_data_no_tags_",
  "w-nicole/childes_data_with_tags",
  "w-nicole/childes_data_with_tags_"
```

cc @severo 