Many things broken since the new 4.0.0 release
MEMBER
Happy to take a look, do you have a list of impacted datasets ?
2025-07-09T23:21:18Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3054410935
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62Dpy3
https://api.github.com/repos/huggingface/datasets/issues/comments/3054410935/reactions
2025-07-09T23:21:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3054410935
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Thanks @lhoestq , related to lm-eval, at least `winogrande`, `mmlu` and `hellaswag`, based on my tests yesterday. But many others like <a href="https://huggingface.co/datasets/lukaemon/bbh">bbh</a>, most probably others too. 
2025-07-10T09:04:40Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3056448516
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62LbQE
https://api.github.com/repos/huggingface/datasets/issues/comments/3056448516/reactions
2025-07-10T09:06:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3056448516
https://avatars.githubusercontent.com/u/37179323?v=4
https://api.github.com/users/mobicham/events{/privacy}
https://api.github.com/users/mobicham/followers
https://api.github.com/users/mobicham/following{/other_user}
https://api.github.com/users/mobicham/gists{/gist_id}
https://github.com/mobicham
mobicham
MDQ6VXNlcjM3MTc5MzIz
https://api.github.com/users/mobicham/orgs
https://api.github.com/users/mobicham/received_events
https://api.github.com/users/mobicham/repos
https://api.github.com/users/mobicham/starred{/owner}{/repo}
https://api.github.com/users/mobicham/subscriptions
User
https://api.github.com/users/mobicham
public
NONE
Hi @mobicham ,

I was having the same issue `ValueError: Feature type 'List' not found` yesterday, when I tried to load my dataset using the `load_dataset()` function.
By updating to `4.0.0`, I don't see this error anymore.

p.s. I used `Sequence` in replace of list when building my dataset (see below)
```
features = Features({
    ...
    "objects": Sequence({
        "id": Value("int64"),
        "bbox": Sequence(Value("float32"), length=4),
        "category": Value("string")
    }),
    ...
})
dataset = Dataset.from_dict(data_dict)
dataset = dataset.cast(features)

``` 

2025-07-10T12:32:41Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3057263523
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62OiOj
https://api.github.com/repos/huggingface/datasets/issues/comments/3057263523/reactions
2025-07-10T12:32:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3057263523
https://avatars.githubusercontent.com/u/177617068?v=4
https://api.github.com/users/zhiying318/events{/privacy}
https://api.github.com/users/zhiying318/followers
https://api.github.com/users/zhiying318/following{/other_user}
https://api.github.com/users/zhiying318/gists{/gist_id}
https://github.com/zhiying318
zhiying318
U_kgDOCpY4rA
https://api.github.com/users/zhiying318/orgs
https://api.github.com/users/zhiying318/received_events
https://api.github.com/users/zhiying318/repos
https://api.github.com/users/zhiying318/starred{/owner}{/repo}
https://api.github.com/users/zhiying318/subscriptions
User
https://api.github.com/users/zhiying318
public
MEMBER
The issue comes from [hails/mmlu_no_train](https://huggingface.co/datasets/hails/mmlu_no_train), [allenai/winogrande](https://huggingface.co/datasets/allenai/winogrande), [lukaemon/bbh](https://huggingface.co/datasets/lukaemon/bbh) and [Rowan/hellaswag](https://huggingface.co/datasets/Rowan/hellaswag) which are all unsupported in `datasets` 4.0 since they are based on python scripts. Fortunately there are PRs to fix those datasets (I did some of them a year ago but dataset authors haven't merged yet... will have to ping people again about it and update here):

- https://huggingface.co/datasets/hails/mmlu_no_train/discussions/2 merged ! ✅ 
- https://huggingface.co/datasets/allenai/winogrande/discussions/6 merged ! ✅ 
- https://huggingface.co/datasets/Rowan/hellaswag/discussions/7 merged ! ✅ 
- https://huggingface.co/datasets/lukaemon/bbh/discussions/2 merged ! ✅ 
2025-07-10T13:51:41Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3057550659
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62PoVD
https://api.github.com/repos/huggingface/datasets/issues/comments/3057550659/reactions
2025-07-13T15:28:02Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3057550659
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Thank you very much @lhoestq , I will try next week 👍 
2025-07-10T16:55:18Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3058235305
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62SPep
https://api.github.com/repos/huggingface/datasets/issues/comments/3058235305/reactions
2025-07-10T16:55:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3058235305
https://avatars.githubusercontent.com/u/37179323?v=4
https://api.github.com/users/mobicham/events{/privacy}
https://api.github.com/users/mobicham/followers
https://api.github.com/users/mobicham/following{/other_user}
https://api.github.com/users/mobicham/gists{/gist_id}
https://github.com/mobicham
mobicham
MDQ6VXNlcjM3MTc5MzIz
https://api.github.com/users/mobicham/orgs
https://api.github.com/users/mobicham/received_events
https://api.github.com/users/mobicham/repos
https://api.github.com/users/mobicham/starred{/owner}{/repo}
https://api.github.com/users/mobicham/subscriptions
User
https://api.github.com/users/mobicham
public
NONE
I get this error when using datasets 3.5.1 to load a dataset saved with datasets 4.0.0. If you are hitting this issue, make sure that both dataset saving code and the loading code are <4.0.0 or >=4.0.0.
2025-07-10T23:45:46Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3059555018
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62XRrK
https://api.github.com/repos/huggingface/datasets/issues/comments/3059555018/reactions
2025-07-10T23:46:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3059555018
https://avatars.githubusercontent.com/u/137927988?v=4
https://api.github.com/users/jsternabsci/events{/privacy}
https://api.github.com/users/jsternabsci/followers
https://api.github.com/users/jsternabsci/following{/other_user}
https://api.github.com/users/jsternabsci/gists{/gist_id}
https://github.com/jsternabsci
jsternabsci
U_kgDOCDidNA
https://api.github.com/users/jsternabsci/orgs
https://api.github.com/users/jsternabsci/received_events
https://api.github.com/users/jsternabsci/repos
https://api.github.com/users/jsternabsci/starred{/owner}{/repo}
https://api.github.com/users/jsternabsci/subscriptions
User
https://api.github.com/users/jsternabsci
public
NONE
This broke several lm-eval-harness workflows for me and reverting to older versions of datasets is not fixing the issue, does anyone have a workaround?
2025-07-11T01:17:58Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3059863298
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62Yc8C
https://api.github.com/repos/huggingface/datasets/issues/comments/3059863298/reactions
2025-07-11T01:18:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3059863298
https://avatars.githubusercontent.com/u/7035671?v=4
https://api.github.com/users/rawsh/events{/privacy}
https://api.github.com/users/rawsh/followers
https://api.github.com/users/rawsh/following{/other_user}
https://api.github.com/users/rawsh/gists{/gist_id}
https://github.com/rawsh
rawsh
MDQ6VXNlcjcwMzU2NzE=
https://api.github.com/users/rawsh/orgs
https://api.github.com/users/rawsh/received_events
https://api.github.com/users/rawsh/repos
https://api.github.com/users/rawsh/starred{/owner}{/repo}
https://api.github.com/users/rawsh/subscriptions
User
https://api.github.com/users/rawsh
public
MEMBER
> I get this error when using datasets 3.5.1 to load a dataset saved with datasets 4.0.0. If you are hitting this issue, make sure that both dataset saving code and the loading code are <4.0.0 or >=4.0.0.

`datasets` 4.0 can load datasets saved using any older version. But the other way around is not always true: if you save a dataset with `datasets` 4.0 it may use the new `List` type that requires 4.0 and raise `ValueError: Feature type 'List' not found.`

However issues with lm eval harness seem to come from another issue: unsupported dataset scripts (see https://github.com/huggingface/datasets/issues/7676#issuecomment-3057550659)

> This broke several lm-eval-harness workflows for me and reverting to older versions of datasets is not fixing the issue, does anyone have a workaround?

when reverting to an old `datasets` version I'd encourage you to clear your cache (by default it is located at `~/.cache/huggingface/datasets`) otherwise it might try to load a `List` type that didn't exist in old versions
2025-07-11T15:24:53Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3062733589
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps62jZsV
https://api.github.com/repos/huggingface/datasets/issues/comments/3062733589/reactions
2025-07-11T15:40:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3062733589
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
All the impacted datasets in lm eval harness have been fixed thanks to the reactivity of dataset authors ! let me know if you encounter issues with other datasets :)
2025-07-13T15:29:39Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3067113656
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps620HC4
https://api.github.com/repos/huggingface/datasets/issues/comments/3067113656/reactions
2025-07-13T15:29:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3067113656
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hello folks, I have found `patrickvonplaten/librispeech_asr_dummy` to be another dataset that is currently broken since the 4.0.0 release. Is there a PR on this as well?
2025-07-17T17:14:39Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3084832703
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps633s-_
https://api.github.com/repos/huggingface/datasets/issues/comments/3084832703/reactions
2025-07-17T17:14:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3084832703
https://avatars.githubusercontent.com/u/195342820?v=4
https://api.github.com/users/jonryuamazon/events{/privacy}
https://api.github.com/users/jonryuamazon/followers
https://api.github.com/users/jonryuamazon/following{/other_user}
https://api.github.com/users/jonryuamazon/gists{/gist_id}
https://github.com/jonryuamazon
jonryuamazon
U_kgDOC6Sx5A
https://api.github.com/users/jonryuamazon/orgs
https://api.github.com/users/jonryuamazon/received_events
https://api.github.com/users/jonryuamazon/repos
https://api.github.com/users/jonryuamazon/starred{/owner}{/repo}
https://api.github.com/users/jonryuamazon/subscriptions
User
https://api.github.com/users/jonryuamazon
public
NONE
https://huggingface.co/datasets/microsoft/prototypical-hai-collaborations seems to be impacted as well.

```
_temp = load_dataset("microsoft/prototypical-hai-collaborations", "wildchat1m_en3u-task_anns")
``` 
leads to 
`ValueError: Feature type 'List' not found. Available feature types: ['Value', 'ClassLabel', 'Translation', 'TranslationVariableLanguages', 'LargeList', 'Sequence', 'Array2D', 'Array3D', 'Array4D', 'Array5D', 'Audio', 'Image', 'Video', 'Pdf']`
2025-07-21T09:27:57Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3095896144
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps64h6BQ
https://api.github.com/repos/huggingface/datasets/issues/comments/3095896144/reactions
2025-07-21T09:27:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3095896144
https://avatars.githubusercontent.com/u/11272436?v=4
https://api.github.com/users/krumeto/events{/privacy}
https://api.github.com/users/krumeto/followers
https://api.github.com/users/krumeto/following{/other_user}
https://api.github.com/users/krumeto/gists{/gist_id}
https://github.com/krumeto
krumeto
MDQ6VXNlcjExMjcyNDM2
https://api.github.com/users/krumeto/orgs
https://api.github.com/users/krumeto/received_events
https://api.github.com/users/krumeto/repos
https://api.github.com/users/krumeto/starred{/owner}{/repo}
https://api.github.com/users/krumeto/subscriptions
User
https://api.github.com/users/krumeto
public
MEMBER
`microsoft/prototypical-hai-collaborations` is not impacted, you can load it using both `datasets` 3.6 and 4.0. I also tried on colab to confirm.

One thing that could explain `ValueError: Feature type 'List' not found.` is maybe if you have loaded and cached this dataset with `datasets` 4.0 and then tried to reload it from cache using 3.6.0.

EDIT: actually I tried and 3.6 can reload datasets cached with 4.0 so I'm not sure why you have this error. Which version of `datasets` are you using ?
2025-07-21T10:33:09Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3096104081
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps64isyR
https://api.github.com/repos/huggingface/datasets/issues/comments/3096104081/reactions
2025-07-21T10:38:01Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3096104081
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
> Hello folks, I have found patrickvonplaten/librispeech_asr_dummy to be another dataset that is currently broken since the 4.0.0 release. Is there a PR on this as well?

I guess you can use [hf-internal-testing/librispeech_asr_dummy](https://huggingface.co/datasets/hf-internal-testing/librispeech_asr_dummy) instead of `patrickvonplaten/librispeech_asr_dummy`, or ask the dataset author to convert their dataset to Parquet
2025-07-21T10:34:47Z
https://github.com/huggingface/datasets/issues/7676#issuecomment-3096113257
https://api.github.com/repos/huggingface/datasets/issues/7676
IC_kwDODunzps64ivBp
https://api.github.com/repos/huggingface/datasets/issues/comments/3096113257/reactions
2025-07-21T10:34:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3096113257
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
### Describe the bug

The new changes in 4.0.0 are breaking many datasets, including those from lm-evaluation-harness. 
I am trying to revert back to older versions, like 3.6.0 to make the eval work but I keep getting:
``` Python
File /venv/main/lib/python3.12/site-packages/datasets/features/features.py:1474, in generate_from_dict(obj)
   1471 class_type = _FEATURE_TYPES.get(_type, None) or globals().get(_type, None)
   1473 if class_type is None:
-> 1474     raise ValueError(f"Feature type '{_type}' not found. Available feature types: {list(_FEATURE_TYPES.keys())}")
   1476 if class_type == LargeList:
   1477     feature = obj.pop("feature")

ValueError: Feature type 'List' not found. Available feature types: ['Value', 'ClassLabel', 'Translation', 'TranslationVariableLanguages', 'LargeList', 'Sequence', 'Array2D', 'Array3D', 'Array4D', 'Array5D', 'Audio', 'Image', 'Video', 'Pdf']

```



### Steps to reproduce the bug

``` Python
import lm_eval
model_eval = lm_eval.models.huggingface.HFLM(pretrained=model, tokenizer=tokenizer)
lm_eval.evaluator.simple_evaluate(model_eval, tasks=["winogrande"], num_fewshot=5, batch_size=1)
```

### Expected behavior

Older `datasets` versions should work just fine as before

### Environment info

- `datasets` version: 3.6.0
- Platform: Linux-6.8.0-60-generic-x86_64-with-glibc2.39
- Python version: 3.12.11
- `huggingface_hub` version: 0.33.1
- PyArrow version: 20.0.0
- Pandas version: 2.3.1
- `fsspec` version: 2025.3.0
