Dataset Viewer issue for darragh/demo_data_raw3
COLLABORATOR
do you have an idea of why it can occur @huggingface/datasets? The dataset consists of a single parquet file.
2022-08-12T15:23:34Z
https://github.com/huggingface/datasets/issues/4840#issuecomment-1213229921
https://api.github.com/repos/huggingface/datasets/issues/4840
IC_kwDODunzps5IUGth
https://api.github.com/repos/huggingface/datasets/issues/comments/1213229921/reactions
2022-08-12T15:23:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1213229921
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
MEMBER
Thanks for reporting @severo.

I'm not able to reproduce that error. I get instead:
```
FileNotFoundError: [Errno 2] No such file or directory: 'orix/data/ChiSig/唐合乐-9-3.jpg'
```

Which pyarrow version are you using? Mine is 6.0.1. 
2022-08-12T15:39:54Z
https://github.com/huggingface/datasets/issues/4840#issuecomment-1213247835
https://api.github.com/repos/huggingface/datasets/issues/4840
IC_kwDODunzps5IULFb
https://api.github.com/repos/huggingface/datasets/issues/comments/1213247835/reactions
2022-08-12T15:39:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1213247835
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
OK, I get now your error when not streaming.
2022-08-12T15:41:13Z
https://github.com/huggingface/datasets/issues/4840#issuecomment-1213249502
https://api.github.com/repos/huggingface/datasets/issues/4840
IC_kwDODunzps5IULfe
https://api.github.com/repos/huggingface/datasets/issues/comments/1213249502/reactions
2022-08-12T15:41:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1213249502
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
COLLABORATOR
OK!

If it's useful, the pyarrow version is 7.0.0:

https://github.com/huggingface/datasets-server/blob/487c39d87998f8d5a35972f1027d6c8e588e622d/services/worker/poetry.lock#L1537-L1543
2022-08-12T15:42:31Z
https://github.com/huggingface/datasets/issues/4840#issuecomment-1213251001
https://api.github.com/repos/huggingface/datasets/issues/4840
IC_kwDODunzps5IUL25
https://api.github.com/repos/huggingface/datasets/issues/comments/1213251001/reactions
2022-08-12T15:42:31Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1213251001
https://avatars.githubusercontent.com/u/1676121?v=4
https://api.github.com/users/severo/events{/privacy}
https://api.github.com/users/severo/followers
https://api.github.com/users/severo/following{/other_user}
https://api.github.com/users/severo/gists{/gist_id}
https://github.com/severo
severo
MDQ6VXNlcjE2NzYxMjE=
https://api.github.com/users/severo/orgs
https://api.github.com/users/severo/received_events
https://api.github.com/users/severo/repos
https://api.github.com/users/severo/starred{/owner}{/repo}
https://api.github.com/users/severo/subscriptions
User
https://api.github.com/users/severo
public
MEMBER
Apparently, there is something weird with that Parquet file: its schema is:
```
images: extension<arrow.py_extension_type<pyarrow.lib.UnknownExtensionType>>
```

I have forced a right schema:
```python
from datasets import Features, Image, load_dataset

features = Features({"images": Image()})
ds = datasets.load_dataset("parquet", split="train", data_files="train-00000-of-00001.parquet", features=features)
```
and then recreated a new Parquet file:
```python
ds.to_parquet("train.parquet")
```

Now this Parquet file has the right schema:
```
images: struct<bytes: binary, path: string>
  child 0, bytes: binary
  child 1, path: string
```
and can be loaded normally:
```python
In [26]: ds = load_dataset("parquet", split="train", data_files="dataset.parquet")
n [27]: ds
Out[27]: 
Dataset({
    features: ['images'],
    num_rows: 20
})
```
2022-08-13T08:08:41Z
https://github.com/huggingface/datasets/issues/4840#issuecomment-1213971952
https://api.github.com/repos/huggingface/datasets/issues/4840
IC_kwDODunzps5IW73w
https://api.github.com/repos/huggingface/datasets/issues/comments/1213971952/reactions
2022-08-13T08:08:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1213971952
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
### Link

https://huggingface.co/datasets/darragh/demo_data_raw3

### Description

```
Exception:     ValueError
Message:       Arrow type extension<arrow.py_extension_type<pyarrow.lib.UnknownExtensionType>> does not have a datasets dtype equivalent.
```
reported by @NielsRogge 

### Owner

No