NotADirectoryError while loading the CNN/Dailymail dataset
MEMBER
Looks like the google drive download failed.
I'm getting a `Google Drive - Quota exceeded` error while looking at the downloaded file.

We should consider finding a better host than google drive for this dataset imo
related : #873 #864 
2020-12-02T11:15:04Z
https://github.com/huggingface/datasets/issues/996#issuecomment-737164722
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDczNzE2NDcyMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/737164722/reactions
2020-12-02T11:15:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/737164722
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
It is working now, thank you. 

Should I leave this issue open to address the Quota-exceeded error?
2020-12-03T11:05:28Z
https://github.com/huggingface/datasets/issues/996#issuecomment-737871214
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDczNzg3MTIxNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/737871214/reactions
2020-12-03T11:05:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/737871214
https://avatars.githubusercontent.com/u/75367920?v=4
https://api.github.com/users/arc-bu/events{/privacy}
https://api.github.com/users/arc-bu/followers
https://api.github.com/users/arc-bu/following{/other_user}
https://api.github.com/users/arc-bu/gists{/gist_id}
https://github.com/arc-bu
arc-bu
MDQ6VXNlcjc1MzY3OTIw
https://api.github.com/users/arc-bu/orgs
https://api.github.com/users/arc-bu/received_events
https://api.github.com/users/arc-bu/repos
https://api.github.com/users/arc-bu/starred{/owner}{/repo}
https://api.github.com/users/arc-bu/subscriptions
User
https://api.github.com/users/arc-bu
public
MEMBER
Yes please. It's been happening several times, we definitely need to address it
2020-12-03T13:17:42Z
https://github.com/huggingface/datasets/issues/996#issuecomment-737985598
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDczNzk4NTU5OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/737985598/reactions
2020-12-03T13:17:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/737985598
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Any updates on this one? I'm facing a similar issue trying to add CelebA.
2021-02-05T14:12:18Z
https://github.com/huggingface/datasets/issues/996#issuecomment-774056320
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDc3NDA1NjMyMA==
https://api.github.com/repos/huggingface/datasets/issues/comments/774056320/reactions
2021-02-05T14:12:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/774056320
https://avatars.githubusercontent.com/u/29076344?v=4
https://api.github.com/users/gchhablani/events{/privacy}
https://api.github.com/users/gchhablani/followers
https://api.github.com/users/gchhablani/following{/other_user}
https://api.github.com/users/gchhablani/gists{/gist_id}
https://github.com/gchhablani
gchhablani
MDQ6VXNlcjI5MDc2MzQ0
https://api.github.com/users/gchhablani/orgs
https://api.github.com/users/gchhablani/received_events
https://api.github.com/users/gchhablani/repos
https://api.github.com/users/gchhablani/starred{/owner}{/repo}
https://api.github.com/users/gchhablani/subscriptions
User
https://api.github.com/users/gchhablani
public
MEMBER
I've looked into it and couldn't find a solution. This looks like a Google Drive limitation..
Please try to use other hosts when possible
2021-02-05T15:28:52Z
https://github.com/huggingface/datasets/issues/996#issuecomment-774102629
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDc3NDEwMjYyOQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/774102629/reactions
2021-02-05T15:28:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/774102629
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
The original links are google drive links.  Would it be feasible for HF to maintain their own servers for this? Also, I think the same issue must also exist with TFDS.
2021-02-05T15:57:16Z
https://github.com/huggingface/datasets/issues/996#issuecomment-774120416
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDc3NDEyMDQxNg==
https://api.github.com/repos/huggingface/datasets/issues/comments/774120416/reactions
2021-02-05T15:57:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/774120416
https://avatars.githubusercontent.com/u/29076344?v=4
https://api.github.com/users/gchhablani/events{/privacy}
https://api.github.com/users/gchhablani/followers
https://api.github.com/users/gchhablani/following{/other_user}
https://api.github.com/users/gchhablani/gists{/gist_id}
https://github.com/gchhablani
gchhablani
MDQ6VXNlcjI5MDc2MzQ0
https://api.github.com/users/gchhablani/orgs
https://api.github.com/users/gchhablani/received_events
https://api.github.com/users/gchhablani/repos
https://api.github.com/users/gchhablani/starred{/owner}{/repo}
https://api.github.com/users/gchhablani/subscriptions
User
https://api.github.com/users/gchhablani
public
MEMBER
It's possible to host data on our side but we should ask the authors. TFDS has the same issue and doesn't have a solution either afaik.
Otherwise you can use the google drive link, but it it's not that convenient because of this quota issue.
2021-02-05T16:05:11Z
https://github.com/huggingface/datasets/issues/996#issuecomment-774125313
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDc3NDEyNTMxMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/774125313/reactions
2021-02-05T16:05:11Z
https://api.github.com/repos/huggingface/datasets/issues/comments/774125313
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Okay. I imagine asking every author who shares their dataset on Google Drive will also be cumbersome.
2021-02-06T16:40:40Z
https://github.com/huggingface/datasets/issues/996#issuecomment-774504549
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDc3NDUwNDU0OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/774504549/reactions
2021-02-06T16:40:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/774504549
https://avatars.githubusercontent.com/u/29076344?v=4
https://api.github.com/users/gchhablani/events{/privacy}
https://api.github.com/users/gchhablani/followers
https://api.github.com/users/gchhablani/following{/other_user}
https://api.github.com/users/gchhablani/gists{/gist_id}
https://github.com/gchhablani
gchhablani
MDQ6VXNlcjI5MDc2MzQ0
https://api.github.com/users/gchhablani/orgs
https://api.github.com/users/gchhablani/received_events
https://api.github.com/users/gchhablani/repos
https://api.github.com/users/gchhablani/starred{/owner}{/repo}
https://api.github.com/users/gchhablani/subscriptions
User
https://api.github.com/users/gchhablani
public
NONE
I am getting this error as well. Is there a fix?
2021-04-05T15:28:48Z
https://github.com/huggingface/datasets/issues/996#issuecomment-813454417
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDgxMzQ1NDQxNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/813454417/reactions
2021-04-05T15:28:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/813454417
https://avatars.githubusercontent.com/u/12277915?v=4
https://api.github.com/users/griff4692/events{/privacy}
https://api.github.com/users/griff4692/followers
https://api.github.com/users/griff4692/following{/other_user}
https://api.github.com/users/griff4692/gists{/gist_id}
https://github.com/griff4692
griff4692
MDQ6VXNlcjEyMjc3OTE1
https://api.github.com/users/griff4692/orgs
https://api.github.com/users/griff4692/received_events
https://api.github.com/users/griff4692/repos
https://api.github.com/users/griff4692/starred{/owner}{/repo}
https://api.github.com/users/griff4692/subscriptions
User
https://api.github.com/users/griff4692
public
MEMBER
Not as long as the data is stored on GG drive unfortunately.
Maybe we can ask if there's a mirror ?

Hi @JafferWilson is there a download link to get cnn dailymail from another host than GG drive ?

To give you some context, this library provides tools to download and process datasets. For CNN DailyMail the data are downloaded from the link you provide on your github repository. Unfortunately because of GG drive quotas, many users are not able to load this dataset.
2021-04-07T14:49:30Z
https://github.com/huggingface/datasets/issues/996#issuecomment-814977579
https://api.github.com/repos/huggingface/datasets/issues/996
MDEyOklzc3VlQ29tbWVudDgxNDk3NzU3OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/814977579/reactions
2021-04-07T14:49:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/814977579
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
The following copy of CNN/DM dataset, fixed the problem for me:
https://huggingface.co/datasets/ccdv/cnn_dailymail
2021-12-19T07:27:56Z
https://github.com/huggingface/datasets/issues/996#issuecomment-997343101
https://api.github.com/repos/huggingface/datasets/issues/996
IC_kwDODunzps47cj99
https://api.github.com/repos/huggingface/datasets/issues/comments/997343101/reactions
2021-12-19T07:27:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/997343101
https://avatars.githubusercontent.com/u/10348086?v=4
https://api.github.com/users/mrazizi/events{/privacy}
https://api.github.com/users/mrazizi/followers
https://api.github.com/users/mrazizi/following{/other_user}
https://api.github.com/users/mrazizi/gists{/gist_id}
https://github.com/mrazizi
mrazizi
MDQ6VXNlcjEwMzQ4MDg2
https://api.github.com/users/mrazizi/orgs
https://api.github.com/users/mrazizi/received_events
https://api.github.com/users/mrazizi/repos
https://api.github.com/users/mrazizi/starred{/owner}{/repo}
https://api.github.com/users/mrazizi/subscriptions
User
https://api.github.com/users/mrazizi
public
MEMBER
Thanks for the link @mrazizi !

Apparently the original authors don't host the dataset themselves ("for legal reasons", source [here](https://github.com/abisee/cnn-dailymail/issues/9)).
2021-12-21T10:20:03Z
https://github.com/huggingface/datasets/issues/996#issuecomment-998653504
https://api.github.com/repos/huggingface/datasets/issues/996
IC_kwDODunzps47hj5A
https://api.github.com/repos/huggingface/datasets/issues/comments/998653504/reactions
2021-12-21T10:20:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/998653504
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public

Downloading and preparing dataset cnn_dailymail/3.0.0 (download: 558.32 MiB, generated: 1.28 GiB, post-processed: Unknown size, total: 1.82 GiB) to /root/.cache/huggingface/datasets/cnn_dailymail/3.0.0/3.0.0/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602...

---------------------------------------------------------------------------

NotADirectoryError                        Traceback (most recent call last)

<ipython-input-9-cd4bf8bea840> in <module>()
     22 
     23 
---> 24 train = load_dataset('cnn_dailymail', '3.0.0', split='train')
     25 validation = load_dataset('cnn_dailymail', '3.0.0', split='validation')
     26 test = load_dataset('cnn_dailymail', '3.0.0', split='test')

5 frames

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _find_files(dl_paths, publisher, url_dict)
    132     else:
    133         logging.fatal("Unsupported publisher: %s", publisher)
--> 134     files = sorted(os.listdir(top_dir))
    135 
    136     ret_files = []

NotADirectoryError: [Errno 20] Not a directory: '/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories'