Fix google drive streaming for small files
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-03-21T11:47:20Z
https://github.com/huggingface/datasets/pull/3979#issuecomment-1073798044
https://api.github.com/repos/huggingface/datasets/issues/3979
IC_kwDODunzps5AANuc
https://api.github.com/repos/huggingface/datasets/issues/comments/1073798044/reactions
2022-03-21T14:30:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1073798044
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
Actually the CI fails because of this
![image](https://user-images.githubusercontent.com/42851186/159281771-78e611b1-6b04-4a87-8324-b6ba2d8c6a6a.png)

It looks like we can't have a proper way to test google drive in the CI right now. Though it seems to work locally if you're not banned. I think I'll just disable those tests for now
2022-03-21T14:25:58Z
https://github.com/huggingface/datasets/pull/3979#issuecomment-1073965240
https://api.github.com/repos/huggingface/datasets/issues/3979
IC_kwDODunzps5AA2i4
https://api.github.com/repos/huggingface/datasets/issues/comments/1073965240/reactions
2022-03-21T14:25:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1073965240
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
COLLABORATOR
this fix will not be included?
2022-03-24T16:43:33Z
https://github.com/huggingface/datasets/pull/3979#issuecomment-1077824936
https://api.github.com/repos/huggingface/datasets/issues/3979
IC_kwDODunzps5APk2o
https://api.github.com/repos/huggingface/datasets/issues/comments/1077824936/reactions
2022-03-24T16:43:33Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1077824936
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
MEMBER
No we can't do anything except stop using google drive when possible
2022-03-24T16:59:11Z
https://github.com/huggingface/datasets/pull/3979#issuecomment-1077838956
https://api.github.com/repos/huggingface/datasets/issues/3979
IC_kwDODunzps5APoRs
https://api.github.com/repos/huggingface/datasets/issues/comments/1077838956/reactions
2022-03-24T16:59:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1077838956
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
Google drive did another change recently, following #3787 #3843 .

In particular Google Drive now returns 403 for GET requests with `confirm=t` when a files doesn't have a virus warning message. I fixed this by passing `confirm=t` if and only if when there is one (i.e. when status code is 200 for HEAD)