load_dataset('cnn_dalymail', '3.0.0') gives a 'Not a directory' error
CONTRIBUTOR
I get the same error. It was fixed some days ago, but again it appears
2020-11-21T12:30:16Z
https://github.com/huggingface/datasets/issues/873#issuecomment-731572690
https://api.github.com/repos/huggingface/datasets/issues/873
MDEyOklzc3VlQ29tbWVudDczMTU3MjY5MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/731572690/reactions
2020-11-21T12:30:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/731572690
https://avatars.githubusercontent.com/u/3653789?v=4
https://api.github.com/users/mrm8488/events{/privacy}
https://api.github.com/users/mrm8488/followers
https://api.github.com/users/mrm8488/following{/other_user}
https://api.github.com/users/mrm8488/gists{/gist_id}
https://github.com/mrm8488
mrm8488
MDQ6VXNlcjM2NTM3ODk=
https://api.github.com/users/mrm8488/orgs
https://api.github.com/users/mrm8488/received_events
https://api.github.com/users/mrm8488/repos
https://api.github.com/users/mrm8488/starred{/owner}{/repo}
https://api.github.com/users/mrm8488/subscriptions
User
https://api.github.com/users/mrm8488
public
NONE
Hi @mrm8488 it's working again today without any fix so I am closing this issue.
2020-11-22T12:18:05Z
https://github.com/huggingface/datasets/issues/873#issuecomment-731739107
https://api.github.com/repos/huggingface/datasets/issues/873
MDEyOklzc3VlQ29tbWVudDczMTczOTEwNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/731739107/reactions
2020-11-22T12:18:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/731739107
https://avatars.githubusercontent.com/u/19861874?v=4
https://api.github.com/users/vishal-burman/events{/privacy}
https://api.github.com/users/vishal-burman/followers
https://api.github.com/users/vishal-burman/following{/other_user}
https://api.github.com/users/vishal-burman/gists{/gist_id}
https://github.com/vishal-burman
vishal-burman
MDQ6VXNlcjE5ODYxODc0
https://api.github.com/users/vishal-burman/orgs
https://api.github.com/users/vishal-burman/received_events
https://api.github.com/users/vishal-burman/repos
https://api.github.com/users/vishal-burman/starred{/owner}{/repo}
https://api.github.com/users/vishal-burman/subscriptions
User
https://api.github.com/users/vishal-burman
public
NONE
I see the issue happening again today - 

[nltk_data] Downloading package stopwords to /root/nltk_data...
[nltk_data]   Package stopwords is already up-to-date!
Downloading and preparing dataset cnn_dailymail/3.0.0 (download: 558.32 MiB, generated: 1.28 GiB, post-processed: Unknown size, total: 1.82 GiB) to /root/.cache/huggingface/datasets/cnn_dailymail/3.0.0/3.0.0/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602...

---------------------------------------------------------------------------

NotADirectoryError                        Traceback (most recent call last)

<ipython-input-9-cd4bf8bea840> in <module>()
     22 
     23 
---> 24 train = load_dataset('cnn_dailymail', '3.0.0', split='train')
     25 validation = load_dataset('cnn_dailymail', '3.0.0', split='validation')
     26 test = load_dataset('cnn_dailymail', '3.0.0', split='test')

5 frames

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _find_files(dl_paths, publisher, url_dict)
    132     else:
    133         logging.fatal("Unsupported publisher: %s", publisher)
--> 134     files = sorted(os.listdir(top_dir))
    135 
    136     ret_files = []

NotADirectoryError: [Errno 20] Not a directory: '/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories'

Can someone please take a look ?
2020-12-02T11:04:21Z
https://github.com/huggingface/datasets/issues/873#issuecomment-737159168
https://api.github.com/repos/huggingface/datasets/issues/873
MDEyOklzc3VlQ29tbWVudDczNzE1OTE2OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/737159168/reactions
2020-12-02T11:04:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/737159168
https://avatars.githubusercontent.com/u/75367920?v=4
https://api.github.com/users/arc-bu/events{/privacy}
https://api.github.com/users/arc-bu/followers
https://api.github.com/users/arc-bu/following{/other_user}
https://api.github.com/users/arc-bu/gists{/gist_id}
https://github.com/arc-bu
arc-bu
MDQ6VXNlcjc1MzY3OTIw
https://api.github.com/users/arc-bu/orgs
https://api.github.com/users/arc-bu/received_events
https://api.github.com/users/arc-bu/repos
https://api.github.com/users/arc-bu/starred{/owner}{/repo}
https://api.github.com/users/arc-bu/subscriptions
User
https://api.github.com/users/arc-bu
public
CONTRIBUTOR
Sometimes happens. Try in a while
2020-12-02T11:10:44Z
https://github.com/huggingface/datasets/issues/873#issuecomment-737162575
https://api.github.com/repos/huggingface/datasets/issues/873
MDEyOklzc3VlQ29tbWVudDczNzE2MjU3NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/737162575/reactions
2020-12-02T11:10:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/737162575
https://avatars.githubusercontent.com/u/3653789?v=4
https://api.github.com/users/mrm8488/events{/privacy}
https://api.github.com/users/mrm8488/followers
https://api.github.com/users/mrm8488/following{/other_user}
https://api.github.com/users/mrm8488/gists{/gist_id}
https://github.com/mrm8488
mrm8488
MDQ6VXNlcjM2NTM3ODk=
https://api.github.com/users/mrm8488/orgs
https://api.github.com/users/mrm8488/received_events
https://api.github.com/users/mrm8488/repos
https://api.github.com/users/mrm8488/starred{/owner}{/repo}
https://api.github.com/users/mrm8488/subscriptions
User
https://api.github.com/users/mrm8488
public
NONE
It is working now, thank you. 
2020-12-03T11:04:15Z
https://github.com/huggingface/datasets/issues/873#issuecomment-737870548
https://api.github.com/repos/huggingface/datasets/issues/873
MDEyOklzc3VlQ29tbWVudDczNzg3MDU0OA==
https://api.github.com/repos/huggingface/datasets/issues/comments/737870548/reactions
2020-12-03T11:04:15Z
https://api.github.com/repos/huggingface/datasets/issues/comments/737870548
https://avatars.githubusercontent.com/u/75367920?v=4
https://api.github.com/users/arc-bu/events{/privacy}
https://api.github.com/users/arc-bu/followers
https://api.github.com/users/arc-bu/following{/other_user}
https://api.github.com/users/arc-bu/gists{/gist_id}
https://github.com/arc-bu
arc-bu
MDQ6VXNlcjc1MzY3OTIw
https://api.github.com/users/arc-bu/orgs
https://api.github.com/users/arc-bu/received_events
https://api.github.com/users/arc-bu/repos
https://api.github.com/users/arc-bu/starred{/owner}{/repo}
https://api.github.com/users/arc-bu/subscriptions
User
https://api.github.com/users/arc-bu
public
NONE
Has anyone solved this ? I still get this error 
2022-02-16T23:23:32Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1042405401
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps4-IdgZ
https://api.github.com/repos/huggingface/datasets/issues/comments/1042405401/reactions
2022-02-16T23:23:32Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1042405401
https://avatars.githubusercontent.com/u/17168743?v=4
https://api.github.com/users/codeislife99/events{/privacy}
https://api.github.com/users/codeislife99/followers
https://api.github.com/users/codeislife99/following{/other_user}
https://api.github.com/users/codeislife99/gists{/gist_id}
https://github.com/codeislife99
codeislife99
MDQ6VXNlcjE3MTY4NzQz
https://api.github.com/users/codeislife99/orgs
https://api.github.com/users/codeislife99/received_events
https://api.github.com/users/codeislife99/repos
https://api.github.com/users/codeislife99/starred{/owner}{/repo}
https://api.github.com/users/codeislife99/subscriptions
User
https://api.github.com/users/codeislife99
public
NONE
> atal("Unsupported publisher: %s", publisher) --> 134 files = sorted(os.listdir(top_dir)) 135 136 ret_files = []
> 
> NotADirectoryError: [Errno 20] Not a directory: '/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories'
> 
> Can someone please take a look ?

2 short-term workarounds:

1.  Use this line instead `dataset = load_dataset('ccdv/cnn_dailymail', '3.0.0')`. [In a related issue](https://github.com/huggingface/datasets/issues/996#issuecomment-997343101), this person mentioned another data source copy that just works.
2.  Use the same data source, but edit the urls.  Instead of google drive quota problems mentioned in #996, I was getting the "can't scan this file for viruses" problem, which results in that prompted html getting downloaded instead of the files.  You can get around this by:
    1. Look at the traceback and find out where `cnn_dailymail.py` is on your computer.
    2. Edit the `cnn_stories` and `dm_stories` url's by adding the following to the end of them `&confirm=t`.  This should be around line 67.
    3. You may have to remove those confirmation html files in your download directory (`~/.cache/huggingface/datasets/downloads` for me) so that they don't get in the way of the new download attempts.

Either method works for me.  I would've made a PR, but not sure if they want to go with the new ccdv/cnn_dailymail source or not.
2022-02-20T17:45:56Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1046287806
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps4-XRW-
https://api.github.com/repos/huggingface/datasets/issues/comments/1046287806/reactions
2022-02-20T17:45:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1046287806
https://avatars.githubusercontent.com/u/2772848?v=4
https://api.github.com/users/davidshinn/events{/privacy}
https://api.github.com/users/davidshinn/followers
https://api.github.com/users/davidshinn/following{/other_user}
https://api.github.com/users/davidshinn/gists{/gist_id}
https://github.com/davidshinn
davidshinn
MDQ6VXNlcjI3NzI4NDg=
https://api.github.com/users/davidshinn/orgs
https://api.github.com/users/davidshinn/received_events
https://api.github.com/users/davidshinn/repos
https://api.github.com/users/davidshinn/starred{/owner}{/repo}
https://api.github.com/users/davidshinn/subscriptions
User
https://api.github.com/users/davidshinn
public
NONE
experience the same problem, ccdv/cnn_dailymail not working either. 

Solve this problem by installing datasets library from the master branch:
python -m pip install git+https://github.com/huggingface/datasets.git@master
2022-03-11T13:16:45Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1065104567
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps4_fDS3
https://api.github.com/repos/huggingface/datasets/issues/comments/1065104567/reactions
2022-03-11T13:16:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1065104567
https://avatars.githubusercontent.com/u/7724786?v=4
https://api.github.com/users/yonwu/events{/privacy}
https://api.github.com/users/yonwu/followers
https://api.github.com/users/yonwu/following{/other_user}
https://api.github.com/users/yonwu/gists{/gist_id}
https://github.com/yonwu
yonwu
MDQ6VXNlcjc3MjQ3ODY=
https://api.github.com/users/yonwu/orgs
https://api.github.com/users/yonwu/received_events
https://api.github.com/users/yonwu/repos
https://api.github.com/users/yonwu/starred{/owner}{/repo}
https://api.github.com/users/yonwu/subscriptions
User
https://api.github.com/users/yonwu
public
NONE
Seem to be getting this again even with 1.18.4. I believe it worked yesterday.
2022-03-16T14:43:23Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1069205955
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps4_usnD
https://api.github.com/repos/huggingface/datasets/issues/comments/1069205955/reactions
2022-03-16T14:43:23Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1069205955
https://avatars.githubusercontent.com/u/45317205?v=4
https://api.github.com/users/jessevig/events{/privacy}
https://api.github.com/users/jessevig/followers
https://api.github.com/users/jessevig/following{/other_user}
https://api.github.com/users/jessevig/gists{/gist_id}
https://github.com/jessevig
jessevig
MDQ6VXNlcjQ1MzE3MjA1
https://api.github.com/users/jessevig/orgs
https://api.github.com/users/jessevig/received_events
https://api.github.com/users/jessevig/repos
https://api.github.com/users/jessevig/starred{/owner}{/repo}
https://api.github.com/users/jessevig/subscriptions
User
https://api.github.com/users/jessevig
public
NONE
Hitting this one as well.
2022-04-21T06:13:20Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1104756326
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps5B2T5m
https://api.github.com/repos/huggingface/datasets/issues/comments/1104756326/reactions
2022-04-21T06:13:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1104756326
https://avatars.githubusercontent.com/u/30500664?v=4
https://api.github.com/users/tomaszdudek7/events{/privacy}
https://api.github.com/users/tomaszdudek7/followers
https://api.github.com/users/tomaszdudek7/following{/other_user}
https://api.github.com/users/tomaszdudek7/gists{/gist_id}
https://github.com/tomaszdudek7
tomaszdudek7
MDQ6VXNlcjMwNTAwNjY0
https://api.github.com/users/tomaszdudek7/orgs
https://api.github.com/users/tomaszdudek7/received_events
https://api.github.com/users/tomaszdudek7/repos
https://api.github.com/users/tomaszdudek7/starred{/owner}{/repo}
https://api.github.com/users/tomaszdudek7/subscriptions
User
https://api.github.com/users/tomaszdudek7
public
NONE
>Hitting this one as well.

Has anyone solved this ? I still get this error
2022-05-05T07:11:47Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1118241039
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps5CpwEP
https://api.github.com/repos/huggingface/datasets/issues/comments/1118241039/reactions
2022-05-05T07:11:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1118241039
https://avatars.githubusercontent.com/u/11155406?v=4
https://api.github.com/users/yoheimiyamoto/events{/privacy}
https://api.github.com/users/yoheimiyamoto/followers
https://api.github.com/users/yoheimiyamoto/following{/other_user}
https://api.github.com/users/yoheimiyamoto/gists{/gist_id}
https://github.com/yoheimiyamoto
yoheimiyamoto
MDQ6VXNlcjExMTU1NDA2
https://api.github.com/users/yoheimiyamoto/orgs
https://api.github.com/users/yoheimiyamoto/received_events
https://api.github.com/users/yoheimiyamoto/repos
https://api.github.com/users/yoheimiyamoto/starred{/owner}{/repo}
https://api.github.com/users/yoheimiyamoto/subscriptions
User
https://api.github.com/users/yoheimiyamoto
public
NONE
@yoheimiyamoto The solution provided by @davidshinn  (i.e. `dataset = load_dataset('ccdv/cnn_dailymail', '3.0.0')`) worked for me.
2022-05-05T07:19:59Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1118245935
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps5CpxQv
https://api.github.com/repos/huggingface/datasets/issues/comments/1118245935/reactions
2022-05-05T07:19:59Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1118245935
https://avatars.githubusercontent.com/u/30500664?v=4
https://api.github.com/users/tomaszdudek7/events{/privacy}
https://api.github.com/users/tomaszdudek7/followers
https://api.github.com/users/tomaszdudek7/following{/other_user}
https://api.github.com/users/tomaszdudek7/gists{/gist_id}
https://github.com/tomaszdudek7
tomaszdudek7
MDQ6VXNlcjMwNTAwNjY0
https://api.github.com/users/tomaszdudek7/orgs
https://api.github.com/users/tomaszdudek7/received_events
https://api.github.com/users/tomaszdudek7/repos
https://api.github.com/users/tomaszdudek7/starred{/owner}{/repo}
https://api.github.com/users/tomaszdudek7/subscriptions
User
https://api.github.com/users/tomaszdudek7
public
NONE
> > atal("Unsupported publisher: %s", publisher) --> 134 files = sorted(os.listdir(top_dir)) 135 136 ret_files = []
> > NotADirectoryError: [Errno 20] Not a directory: '/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories'
> > Can someone please take a look ?
> 
> 2 short-term workarounds:
> 
> 1. Use this line instead `dataset = load_dataset('ccdv/cnn_dailymail', '3.0.0')`. [In a related issue](https://github.com/huggingface/datasets/issues/996#issuecomment-997343101), this person mentioned another data source copy that just works.
> 2. Use the same data source, but edit the urls.  Instead of google drive quota problems mentioned in [NotADirectoryError while loading the CNN/Dailymail dataset #996](https://github.com/huggingface/datasets/issues/996), I was getting the "can't scan this file for viruses" problem, which results in that prompted html getting downloaded instead of the files.  You can get around this by:
>    
>    1. Look at the traceback and find out where `cnn_dailymail.py` is on your computer.
>    2. Edit the `cnn_stories` and `dm_stories` url's by adding the following to the end of them `&confirm=t`.  This should be around line 67.
>    3. You may have to remove those confirmation html files in your download directory (`~/.cache/huggingface/datasets/downloads` for me) so that they don't get in the way of the new download attempts.
> 
> Either method works for me. I would've made a PR, but not sure if they want to go with the new ccdv/cnn_dailymail source or not.

Thankyou, editing the urls helped me than the loading dataset line.
2023-08-03T12:07:03Z
https://github.com/huggingface/datasets/issues/873#issuecomment-1663863802
https://api.github.com/repos/huggingface/datasets/issues/873
IC_kwDODunzps5jLIv6
https://api.github.com/repos/huggingface/datasets/issues/comments/1663863802/reactions
2023-08-03T12:07:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1663863802
https://avatars.githubusercontent.com/u/42197724?v=4
https://api.github.com/users/BURJAMANISHA/events{/privacy}
https://api.github.com/users/BURJAMANISHA/followers
https://api.github.com/users/BURJAMANISHA/following{/other_user}
https://api.github.com/users/BURJAMANISHA/gists{/gist_id}
https://github.com/BURJAMANISHA
BURJAMANISHA
MDQ6VXNlcjQyMTk3NzI0
https://api.github.com/users/BURJAMANISHA/orgs
https://api.github.com/users/BURJAMANISHA/received_events
https://api.github.com/users/BURJAMANISHA/repos
https://api.github.com/users/BURJAMANISHA/starred{/owner}{/repo}
https://api.github.com/users/BURJAMANISHA/subscriptions
User
https://api.github.com/users/BURJAMANISHA
public
```
from datasets import load_dataset
dataset = load_dataset('cnn_dailymail', '3.0.0')
```
Stack trace:
```
---------------------------------------------------------------------------

NotADirectoryError                        Traceback (most recent call last)

<ipython-input-6-2e06a8332652> in <module>()
      1 from datasets import load_dataset
----> 2 dataset = load_dataset('cnn_dailymail', '3.0.0')

5 frames

/usr/local/lib/python3.6/dist-packages/datasets/load.py in load_dataset(path, name, data_dir, data_files, split, cache_dir, features, download_config, download_mode, ignore_verifications, save_infos, script_version, **config_kwargs)
    608         download_config=download_config,
    609         download_mode=download_mode,
--> 610         ignore_verifications=ignore_verifications,
    611     )
    612 

/usr/local/lib/python3.6/dist-packages/datasets/builder.py in download_and_prepare(self, download_config, download_mode, ignore_verifications, try_from_hf_gcs, dl_manager, **download_and_prepare_kwargs)
    513                     if not downloaded_from_gcs:
    514                         self._download_and_prepare(
--> 515                             dl_manager=dl_manager, verify_infos=verify_infos, **download_and_prepare_kwargs
    516                         )
    517                     # Sync info

/usr/local/lib/python3.6/dist-packages/datasets/builder.py in _download_and_prepare(self, dl_manager, verify_infos, **prepare_split_kwargs)
    568         split_dict = SplitDict(dataset_name=self.name)
    569         split_generators_kwargs = self._make_split_generators_kwargs(prepare_split_kwargs)
--> 570         split_generators = self._split_generators(dl_manager, **split_generators_kwargs)
    571 
    572         # Checksums verification

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _split_generators(self, dl_manager)
    252     def _split_generators(self, dl_manager):
    253         dl_paths = dl_manager.download_and_extract(_DL_URLS)
--> 254         train_files = _subset_filenames(dl_paths, datasets.Split.TRAIN)
    255         # Generate shared vocabulary
    256 

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _subset_filenames(dl_paths, split)
    153     else:
    154         logging.fatal("Unsupported split: %s", split)
--> 155     cnn = _find_files(dl_paths, "cnn", urls)
    156     dm = _find_files(dl_paths, "dm", urls)
    157     return cnn + dm

/root/.cache/huggingface/modules/datasets_modules/datasets/cnn_dailymail/0128610a44e10f25b4af6689441c72af86205282d26399642f7db38fa7535602/cnn_dailymail.py in _find_files(dl_paths, publisher, url_dict)
    132     else:
    133         logging.fatal("Unsupported publisher: %s", publisher)
--> 134     files = sorted(os.listdir(top_dir))
    135 
    136     ret_files = []

NotADirectoryError: [Errno 20] Not a directory: '/root/.cache/huggingface/datasets/downloads/1bc05d24fa6dda2468e83a73cf6dc207226e01e3c48a507ea716dc0421da583b/cnn/stories'
```
I have ran the code on Google Colab