raise FileNotFoundError("Directory {dataset_path} is neither a `Dataset` directory nor a `DatasetDict` directory." )
NONE
any idea?
2023-08-17T13:41:08Z
https://github.com/huggingface/datasets/issues/6111#issuecomment-1682308605
https://api.github.com/repos/huggingface/datasets/issues/6111
IC_kwDODunzps5kRf39
https://api.github.com/repos/huggingface/datasets/issues/comments/1682308605/reactions
2023-08-17T13:41:08Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1682308605
https://avatars.githubusercontent.com/u/42762740?v=4
https://api.github.com/users/catqaq/events{/privacy}
https://api.github.com/users/catqaq/followers
https://api.github.com/users/catqaq/following{/other_user}
https://api.github.com/users/catqaq/gists{/gist_id}
https://github.com/catqaq
catqaq
MDQ6VXNlcjQyNzYyNzQw
https://api.github.com/users/catqaq/orgs
https://api.github.com/users/catqaq/received_events
https://api.github.com/users/catqaq/repos
https://api.github.com/users/catqaq/starred{/owner}{/repo}
https://api.github.com/users/catqaq/subscriptions
User
https://api.github.com/users/catqaq
public
COLLABORATOR
This should work: `load_dataset("path/to/downloaded_repo")`

`load_from_disk` is intended to be used on directories created with `Dataset.save_to_disk` or `DatasetDict.save_to_disk`
2023-08-17T14:06:02Z
https://github.com/huggingface/datasets/issues/6111#issuecomment-1682351489
https://api.github.com/repos/huggingface/datasets/issues/6111
IC_kwDODunzps5kRqWB
https://api.github.com/repos/huggingface/datasets/issues/comments/1682351489/reactions
2023-08-17T14:06:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1682351489
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
> This should work: `load_dataset("path/to/downloaded_repo")`
> 
> `load_from_disk` is intended to be used on directories created with `Dataset.save_to_disk` or `DatasetDict.save_to_disk`

Thanks for your help. This works.
2023-08-29T02:00:28Z
https://github.com/huggingface/datasets/issues/6111#issuecomment-1696656777
https://api.github.com/repos/huggingface/datasets/issues/6111
IC_kwDODunzps5lIO2J
https://api.github.com/repos/huggingface/datasets/issues/comments/1696656777/reactions
2023-08-29T02:00:28Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1696656777
https://avatars.githubusercontent.com/u/41530341?v=4
https://api.github.com/users/2catycm/events{/privacy}
https://api.github.com/users/2catycm/followers
https://api.github.com/users/2catycm/following{/other_user}
https://api.github.com/users/2catycm/gists{/gist_id}
https://github.com/2catycm
2catycm
MDQ6VXNlcjQxNTMwMzQx
https://api.github.com/users/2catycm/orgs
https://api.github.com/users/2catycm/received_events
https://api.github.com/users/2catycm/repos
https://api.github.com/users/2catycm/starred{/owner}{/repo}
https://api.github.com/users/2catycm/subscriptions
User
https://api.github.com/users/2catycm
public
### Describe the bug

For researchers in some countries or regions, it is usually the case that the download ability of `load_dataset` is disabled due to the complex network environment. People in these regions often prefer to use git clone or other programming tricks to manually download the files to the disk (for example, [How to elegantly download hf models, zhihu zhuanlan](https://zhuanlan.zhihu.com/p/475260268) proposed a crawlder based solution,  and [Is there any mirror for hf_hub, zhihu answer](https://www.zhihu.com/question/371644077) provided some cloud based solutions, and [How to avoid pitfalls on Hugging face downloading, zhihu zhuanlan] gave some useful suggestions), and then use `load_from_disk` to get the dataset object. 
However, when one finally has the local files on the disk, it is still buggy when trying to load the files into objects. 

### Steps to reproduce the bug

Steps to reproduce the bug:
1. Found CIFAR dataset in hugging face: https://huggingface.co/datasets/cifar100/tree/main
2. Click ":" button to show "Clone repository" option, and then follow the prompts on the box:
 ```bash
  cd my_directory_absolute
  git lfs install
  git clone https://huggingface.co/datasets/cifar100
  ls  my_directory_absolute/cifar100 # confirm that the directory exists and it is OK. 
  ```
3. Write A python file to try to load the dataset
```python
from datasets import load_dataset, load_from_disk
dataset = load_from_disk("my_directory_absolute/cifar100")
```
Notice that according to issue #3700 , it is wrong to use load_dataset("my_directory_absolute/cifar100"), so we must use load_from_disk instead. 

4. Then you will see the error reported:
```log
---------------------------------------------------------------------------
FileNotFoundError                         Traceback (most recent call last)
Cell In[5], line 9
      1 from datasets import load_dataset, load_from_disk
----> 9 dataset = load_from_disk("my_directory_absolute/cifar100")

File [~/miniconda3/envs/ai/lib/python3.10/site-packages/datasets/load.py:2232), in load_from_disk(dataset_path, fs, keep_in_memory, storage_options)
   2230     return DatasetDict.load_from_disk(dataset_path, keep_in_memory=keep_in_memory, storage_options=storage_options)
   2231 else:
-> 2232     raise FileNotFoundError(
   2233         f"Directory {dataset_path} is neither a `Dataset` directory nor a `DatasetDict` directory."
   2234     )

FileNotFoundError: Directory my_directory_absolute/cifar100 is neither a `Dataset` directory nor a `DatasetDict` directory.
```

### Expected behavior

The dataset should be load successfully. 

### Environment info

```bash
datasets-cli env
```
-> results:
```txt

Copy-and-paste the text below in your GitHub issue.

- `datasets` version: 2.14.2
- Platform: Linux-4.18.0-372.32.1.el8_6.x86_64-x86_64-with-glibc2.28
- Python version: 3.10.12
- Huggingface_hub version: 0.16.4
- PyArrow version: 12.0.1
- Pandas version: 2.0.3
```