The "all" split breaks streaming
MEMBER
Thanks for reporting @cakiki.

Yes, this is a bug. We are investigating it.
2022-07-06T07:07:55Z
https://github.com/huggingface/datasets/issues/4637#issuecomment-1175860124
https://api.github.com/repos/huggingface/datasets/issues/4637
IC_kwDODunzps5GFjOc
https://api.github.com/repos/huggingface/datasets/issues/comments/1175860124/reactions
2022-07-06T07:07:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1175860124
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
CONTRIBUTOR
@albertvillanova Nice! Let me know if it's something I can fix my self; would love to contribtue!
2022-07-06T08:14:58Z
https://github.com/huggingface/datasets/issues/4637#issuecomment-1175923435
https://api.github.com/repos/huggingface/datasets/issues/4637
IC_kwDODunzps5GFyrr
https://api.github.com/repos/huggingface/datasets/issues/comments/1175923435/reactions
2022-07-06T08:14:58Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1175923435
https://avatars.githubusercontent.com/u/3664563?v=4
https://api.github.com/users/cakiki/events{/privacy}
https://api.github.com/users/cakiki/followers
https://api.github.com/users/cakiki/following{/other_user}
https://api.github.com/users/cakiki/gists{/gist_id}
https://github.com/cakiki
cakiki
MDQ6VXNlcjM2NjQ1NjM=
https://api.github.com/users/cakiki/orgs
https://api.github.com/users/cakiki/received_events
https://api.github.com/users/cakiki/repos
https://api.github.com/users/cakiki/starred{/owner}{/repo}
https://api.github.com/users/cakiki/subscriptions
User
https://api.github.com/users/cakiki
public
MEMBER
@cakiki I was working on this but if you would like to contribute, go ahead. I will close my PR. ;)

For the moment I just pushed the test (to see if it impacts other tests).
2022-07-06T08:57:32Z
https://github.com/huggingface/datasets/issues/4637#issuecomment-1175965718
https://api.github.com/repos/huggingface/datasets/issues/4637
IC_kwDODunzps5GF9AW
https://api.github.com/repos/huggingface/datasets/issues/comments/1175965718/reactions
2022-07-06T09:00:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1175965718
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
It impacted the test `test_generator_based_download_and_prepare` and I have fixed this.

So that you can copy the test I implemented in my PR and then implement a fix for this issue that passes the test `tests/test_builder.py::test_builder_as_streaming_dataset`.
2022-07-06T09:16:03Z
https://github.com/huggingface/datasets/issues/4637#issuecomment-1175984812
https://api.github.com/repos/huggingface/datasets/issues/4637
IC_kwDODunzps5GGBqs
https://api.github.com/repos/huggingface/datasets/issues/comments/1175984812/reactions
2022-07-06T09:16:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1175984812
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
Hi @cakiki are you still interested in working on this? Are you planning to open a PR?
2022-07-15T13:53:55Z
https://github.com/huggingface/datasets/issues/4637#issuecomment-1185569993
https://api.github.com/repos/huggingface/datasets/issues/4637
IC_kwDODunzps5GqlzJ
https://api.github.com/repos/huggingface/datasets/issues/comments/1185569993/reactions
2022-07-15T13:53:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1185569993
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
CONTRIBUTOR
Hi @albertvillanova ! Sorry it took so long; I wanted to spend this weekend working on it.
2022-07-15T13:59:30Z
https://github.com/huggingface/datasets/issues/4637#issuecomment-1185575025
https://api.github.com/repos/huggingface/datasets/issues/4637
IC_kwDODunzps5GqnBx
https://api.github.com/repos/huggingface/datasets/issues/comments/1185575025/reactions
2022-07-15T13:59:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1185575025
https://avatars.githubusercontent.com/u/3664563?v=4
https://api.github.com/users/cakiki/events{/privacy}
https://api.github.com/users/cakiki/followers
https://api.github.com/users/cakiki/following{/other_user}
https://api.github.com/users/cakiki/gists{/gist_id}
https://github.com/cakiki
cakiki
MDQ6VXNlcjM2NjQ1NjM=
https://api.github.com/users/cakiki/orgs
https://api.github.com/users/cakiki/received_events
https://api.github.com/users/cakiki/repos
https://api.github.com/users/cakiki/starred{/owner}{/repo}
https://api.github.com/users/cakiki/subscriptions
User
https://api.github.com/users/cakiki
public
## Describe the bug

Not sure if this is a bug or just the way streaming works, but setting `streaming=True` did not work when setting `split="all"`

## Steps to reproduce the bug
The following works:
```python
ds = load_dataset('super_glue', 'wsc.fixed', split='all')
```
The following throws `ValueError: Bad split: all. Available splits: ['train', 'validation', 'test']`:

```python
ds = load_dataset('super_glue', 'wsc.fixed', split='all', streaming=True)
```

## Expected results
An iterator over all splits.

## Actual results
I had to do the following to achieve the desired result:
```python
from itertools import chain
ds = load_dataset('super_glue', 'wsc.fixed', streaming=True)
it =  chain.from_iterable(ds.values())
```

## Environment info
<!-- You can run the command `datasets-cli env` and copy-and-paste its output below. -->
- `datasets` version: 2.3.2
- Platform: Linux-4.15.0-176-generic-x86_64-with-glibc2.31
- Python version: 3.10.5
- PyArrow version: 8.0.0
- Pandas version: 1.4.3
