Fix: Bypass Virus Checks in Google Drive Links (CNN-DM dataset)
NONE
Thank you, @albertvillanova!
2022-02-25T09:06:34Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1050667379
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4-n-lz
https://api.github.com/repos/huggingface/datasets/issues/comments/1050667379/reactions
2022-02-25T09:06:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1050667379
https://avatars.githubusercontent.com/u/58678541?v=4
https://api.github.com/users/AngadSethi/events{/privacy}
https://api.github.com/users/AngadSethi/followers
https://api.github.com/users/AngadSethi/following{/other_user}
https://api.github.com/users/AngadSethi/gists{/gist_id}
https://github.com/AngadSethi
AngadSethi
MDQ6VXNlcjU4Njc4NTQx
https://api.github.com/users/AngadSethi/orgs
https://api.github.com/users/AngadSethi/received_events
https://api.github.com/users/AngadSethi/repos
https://api.github.com/users/AngadSethi/starred{/owner}{/repo}
https://api.github.com/users/AngadSethi/subscriptions
User
https://api.github.com/users/AngadSethi
public
NONE
Got it. Thanks for explaining this, @albertvillanova!

> On the other hand, the tests are not passing because the dummy data should also be fixed. Once done, this PR will be able to be merged into master.

Will do this 👍
2022-02-25T10:24:38Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1050727353
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4-oNO5
https://api.github.com/repos/huggingface/datasets/issues/comments/1050727353/reactions
2022-02-25T10:24:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1050727353
https://avatars.githubusercontent.com/u/58678541?v=4
https://api.github.com/users/AngadSethi/events{/privacy}
https://api.github.com/users/AngadSethi/followers
https://api.github.com/users/AngadSethi/following{/other_user}
https://api.github.com/users/AngadSethi/gists{/gist_id}
https://github.com/AngadSethi
AngadSethi
MDQ6VXNlcjU4Njc4NTQx
https://api.github.com/users/AngadSethi/orgs
https://api.github.com/users/AngadSethi/received_events
https://api.github.com/users/AngadSethi/repos
https://api.github.com/users/AngadSethi/starred{/owner}{/repo}
https://api.github.com/users/AngadSethi/subscriptions
User
https://api.github.com/users/AngadSethi
public
MEMBER
Hi ! I think we need to fix the issue for every dataset. This can be done simply by fixing how we handle Google Drive links, see my comment https://github.com/huggingface/datasets/pull/3775#issuecomment-1050970157
2022-02-25T15:53:52Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1050973450
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4-pJUK
https://api.github.com/repos/huggingface/datasets/issues/comments/1050973450/reactions
2022-02-25T15:53:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1050973450
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hi @lhoestq! I think @albertvillanova has already fixed this in #3787
2022-02-25T17:31:10Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1051051518
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4-pcX-
https://api.github.com/repos/huggingface/datasets/issues/comments/1051051518/reactions
2022-02-25T17:31:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1051051518
https://avatars.githubusercontent.com/u/58678541?v=4
https://api.github.com/users/AngadSethi/events{/privacy}
https://api.github.com/users/AngadSethi/followers
https://api.github.com/users/AngadSethi/following{/other_user}
https://api.github.com/users/AngadSethi/gists{/gist_id}
https://github.com/AngadSethi
AngadSethi
MDQ6VXNlcjU4Njc4NTQx
https://api.github.com/users/AngadSethi/orgs
https://api.github.com/users/AngadSethi/received_events
https://api.github.com/users/AngadSethi/repos
https://api.github.com/users/AngadSethi/starred{/owner}{/repo}
https://api.github.com/users/AngadSethi/subscriptions
User
https://api.github.com/users/AngadSethi
public
MEMBER
Cool ! I missed this one :) thanks
2022-02-25T17:35:50Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1051055083
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4-pdPr
https://api.github.com/repos/huggingface/datasets/issues/comments/1051055083/reactions
2022-02-25T17:35:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1051055083
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
No problem!
2022-02-25T17:39:28Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1051058068
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4-pd-U
https://api.github.com/repos/huggingface/datasets/issues/comments/1051058068/reactions
2022-02-25T17:39:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1051058068
https://avatars.githubusercontent.com/u/58678541?v=4
https://api.github.com/users/AngadSethi/events{/privacy}
https://api.github.com/users/AngadSethi/followers
https://api.github.com/users/AngadSethi/following{/other_user}
https://api.github.com/users/AngadSethi/gists{/gist_id}
https://github.com/AngadSethi
AngadSethi
MDQ6VXNlcjU4Njc4NTQx
https://api.github.com/users/AngadSethi/orgs
https://api.github.com/users/AngadSethi/received_events
https://api.github.com/users/AngadSethi/repos
https://api.github.com/users/AngadSethi/starred{/owner}{/repo}
https://api.github.com/users/AngadSethi/subscriptions
User
https://api.github.com/users/AngadSethi
public
MEMBER
Hi, @AngadSethi, I think that once:
- #3787 

was merged, issue:
- #3784 

was also fixed.

Therefore, I think this PR is no longer necessary. I'm closing it. Let me know if you agree.
2022-03-03T14:03:37Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1058072683
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4_EOhr
https://api.github.com/repos/huggingface/datasets/issues/comments/1058072683/reactions
2022-03-03T14:03:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1058072683
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
NONE
Yes, absolutely @albertvillanova! I agree :)
2022-03-03T16:43:37Z
https://github.com/huggingface/datasets/pull/3785#issuecomment-1058247227
https://api.github.com/repos/huggingface/datasets/issues/3785
IC_kwDODunzps4_E5I7
https://api.github.com/repos/huggingface/datasets/issues/comments/1058247227/reactions
2022-03-03T16:43:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1058247227
https://avatars.githubusercontent.com/u/58678541?v=4
https://api.github.com/users/AngadSethi/events{/privacy}
https://api.github.com/users/AngadSethi/followers
https://api.github.com/users/AngadSethi/following{/other_user}
https://api.github.com/users/AngadSethi/gists{/gist_id}
https://github.com/AngadSethi
AngadSethi
MDQ6VXNlcjU4Njc4NTQx
https://api.github.com/users/AngadSethi/orgs
https://api.github.com/users/AngadSethi/received_events
https://api.github.com/users/AngadSethi/repos
https://api.github.com/users/AngadSethi/starred{/owner}{/repo}
https://api.github.com/users/AngadSethi/subscriptions
User
https://api.github.com/users/AngadSethi
public
This commit fixes the issue described in #3784. By adding an extra parameter to the end of Google Drive links, we are able to bypass the virus check and download the datasets.

So, if the original link looked like https://drive.google.com/uc?export=download&id=0BwmD_VLjROrfTHk4NFg2SndKcjQ

The new link now looks like https://drive.google.com/uc?export=download&id=0BwmD_VLjROrfTHk4NFg2SndKcjQ&confirm=t

Fixes #3784