Remove scripts altogether
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_7592). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
2025-06-04T15:17:16Z
https://github.com/huggingface/datasets/pull/7592#issuecomment-2940431479
https://api.github.com/repos/huggingface/datasets/issues/7592
IC_kwDODunzps6vQ2x3
https://api.github.com/repos/huggingface/datasets/issues/comments/2940431479/reactions
2025-06-04T15:17:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2940431479
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
Hi @lhoestq,
I wanted to ask
are you planning to stop supporting dataset builds using `GeneratorBasedBuilder`?

If so, could you share the reason why?
2025-07-14T06:57:27Z
https://github.com/huggingface/datasets/pull/7592#issuecomment-3068065217
https://api.github.com/repos/huggingface/datasets/issues/7592
IC_kwDODunzps623vXB
https://api.github.com/repos/huggingface/datasets/issues/comments/3068065217/reactions
2025-07-14T06:59:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3068065217
https://avatars.githubusercontent.com/u/93233241?v=4
https://api.github.com/users/jp1924/events{/privacy}
https://api.github.com/users/jp1924/followers
https://api.github.com/users/jp1924/following{/other_user}
https://api.github.com/users/jp1924/gists{/gist_id}
https://github.com/jp1924
jp1924
U_kgDOBY6gWQ
https://api.github.com/users/jp1924/orgs
https://api.github.com/users/jp1924/received_events
https://api.github.com/users/jp1924/repos
https://api.github.com/users/jp1924/starred{/owner}{/repo}
https://api.github.com/users/jp1924/subscriptions
User
https://api.github.com/users/jp1924
public
MEMBER
We stopped supporting dataset scripts altogether, whether they are based on GeneratorBasedBuilder or any other builder. This means you can't `load_dataset()` a dataset script anymore. We did this mostly for security reasons which is blocking for many users and also impossible to build upon (e.g. the for the Dataset Viewer on HF)
2025-07-15T10:23:14Z
https://github.com/huggingface/datasets/pull/7592#issuecomment-3073053138
https://api.github.com/repos/huggingface/datasets/issues/7592
IC_kwDODunzps63KxHS
https://api.github.com/repos/huggingface/datasets/issues/comments/3073053138/reactions
2025-07-15T10:23:14Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3073053138
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Ah, so only the `trust_remote_code` feature of `load_dataset` is deprecated, and

```python
from datasets import load_dataset_builder
  
builder = load_dataset_builder('cornell-movie-review-data/rotten_tomatoes')  
builder.download_and_prepare()  
```

we can still load data using `load_dataset_builder` and `download_and_prepare`, right?
That's a relief. I thought the removal of `trust_remote_code` in `load_dataset` meant `GeneratorBasedBuilder` was being deprecated too, haha.
Got it, thanks for the clarification!

2025-07-16T18:59:07Z
https://github.com/huggingface/datasets/pull/7592#issuecomment-3079918731
https://api.github.com/repos/huggingface/datasets/issues/7592
IC_kwDODunzps63k9SL
https://api.github.com/repos/huggingface/datasets/issues/comments/3079918731/reactions
2025-07-16T18:59:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3079918731
https://avatars.githubusercontent.com/u/93233241?v=4
https://api.github.com/users/jp1924/events{/privacy}
https://api.github.com/users/jp1924/followers
https://api.github.com/users/jp1924/following{/other_user}
https://api.github.com/users/jp1924/gists{/gist_id}
https://github.com/jp1924
jp1924
U_kgDOBY6gWQ
https://api.github.com/users/jp1924/orgs
https://api.github.com/users/jp1924/received_events
https://api.github.com/users/jp1924/repos
https://api.github.com/users/jp1924/starred{/owner}{/repo}
https://api.github.com/users/jp1924/subscriptions
User
https://api.github.com/users/jp1924
public
NONE
Can you give an example on how to upgrade from using `trust_remote_code`? I used to load_dataset from a script generating my training data in a streaming way.
2025-08-04T15:14:06Z
https://github.com/huggingface/datasets/pull/7592#issuecomment-3151194811
https://api.github.com/repos/huggingface/datasets/issues/7592
IC_kwDODunzps6702q7
https://api.github.com/repos/huggingface/datasets/issues/comments/3151194811/reactions
2025-08-04T15:14:06Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3151194811
https://avatars.githubusercontent.com/u/758925?v=4
https://api.github.com/users/autosquid/events{/privacy}
https://api.github.com/users/autosquid/followers
https://api.github.com/users/autosquid/following{/other_user}
https://api.github.com/users/autosquid/gists{/gist_id}
https://github.com/autosquid
autosquid
MDQ6VXNlcjc1ODkyNQ==
https://api.github.com/users/autosquid/orgs
https://api.github.com/users/autosquid/received_events
https://api.github.com/users/autosquid/repos
https://api.github.com/users/autosquid/starred{/owner}{/repo}
https://api.github.com/users/autosquid/subscriptions
User
https://api.github.com/users/autosquid
public
NONE
For guys who dislike this change +1
2025-08-04T15:16:46Z
https://github.com/huggingface/datasets/pull/7592#issuecomment-3151205337
https://api.github.com/repos/huggingface/datasets/issues/7592
IC_kwDODunzps6705PZ
https://api.github.com/repos/huggingface/datasets/issues/comments/3151205337/reactions
2025-08-04T15:17:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3151205337
https://avatars.githubusercontent.com/u/758925?v=4
https://api.github.com/users/autosquid/events{/privacy}
https://api.github.com/users/autosquid/followers
https://api.github.com/users/autosquid/following{/other_user}
https://api.github.com/users/autosquid/gists{/gist_id}
https://github.com/autosquid
autosquid
MDQ6VXNlcjc1ODkyNQ==
https://api.github.com/users/autosquid/orgs
https://api.github.com/users/autosquid/received_events
https://api.github.com/users/autosquid/repos
https://api.github.com/users/autosquid/starred{/owner}{/repo}
https://api.github.com/users/autosquid/subscriptions
User
https://api.github.com/users/autosquid
public
TODO:
- [x] remplace fixtures based on script with no-script fixtures
- [x] windaube