cannot combine splits merging and streaming?
MEMBER
Hi ! That's missing indeed. We'll try to implement this for the next version :)

I guess we just need to implement #2564 first, and then we should be able to add support for splits combinations
2021-07-22T08:27:47Z
https://github.com/huggingface/datasets/issues/2699#issuecomment-884740652
https://api.github.com/repos/huggingface/datasets/issues/2699
IC_kwDODunzps40vBIs
https://api.github.com/repos/huggingface/datasets/issues/comments/884740652/reactions
2021-07-22T08:27:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/884740652
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
is there an update on this? ran into the same issue on 2.17.1.

On a similar note, the keyword `split="all"` also does not work as intended when `streaming=True`. 
2024-03-21T03:33:12Z
https://github.com/huggingface/datasets/issues/2699#issuecomment-2011157580
https://api.github.com/repos/huggingface/datasets/issues/2699
IC_kwDODunzps5339RM
https://api.github.com/repos/huggingface/datasets/issues/comments/2011157580/reactions
2024-03-21T03:35:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2011157580
https://avatars.githubusercontent.com/u/27675252?v=4
https://api.github.com/users/kdonbekci/events{/privacy}
https://api.github.com/users/kdonbekci/followers
https://api.github.com/users/kdonbekci/following{/other_user}
https://api.github.com/users/kdonbekci/gists{/gist_id}
https://github.com/kdonbekci
kdonbekci
MDQ6VXNlcjI3Njc1MjUy
https://api.github.com/users/kdonbekci/orgs
https://api.github.com/users/kdonbekci/received_events
https://api.github.com/users/kdonbekci/repos
https://api.github.com/users/kdonbekci/starred{/owner}{/repo}
https://api.github.com/users/kdonbekci/subscriptions
User
https://api.github.com/users/kdonbekci
public
MEMBER
No update so far, especially since we haven't implemented an efficient way to query `split=train[50%:]` for example. The addition of two splits should be easy though, since we have `concatenate_datasets()`
2024-03-21T09:55:42Z
https://github.com/huggingface/datasets/issues/2699#issuecomment-2011787841
https://api.github.com/repos/huggingface/datasets/issues/2699
IC_kwDODunzps536XJB
https://api.github.com/repos/huggingface/datasets/issues/comments/2011787841/reactions
2024-03-21T09:55:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2011787841
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Can you concatenate_datasets that are being streamed now? I was led to believe concatenation works on non streaming datasets only.
2024-04-05T00:27:38Z
https://github.com/huggingface/datasets/issues/2699#issuecomment-2038494180
https://api.github.com/repos/huggingface/datasets/issues/2699
IC_kwDODunzps55gPPk
https://api.github.com/repos/huggingface/datasets/issues/comments/2038494180/reactions
2024-04-05T00:27:38Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2038494180
https://avatars.githubusercontent.com/u/68586838?v=4
https://api.github.com/users/prajwalpkn/events{/privacy}
https://api.github.com/users/prajwalpkn/followers
https://api.github.com/users/prajwalpkn/following{/other_user}
https://api.github.com/users/prajwalpkn/gists{/gist_id}
https://github.com/prajwalpkn
prajwalpkn
MDQ6VXNlcjY4NTg2ODM4
https://api.github.com/users/prajwalpkn/orgs
https://api.github.com/users/prajwalpkn/received_events
https://api.github.com/users/prajwalpkn/repos
https://api.github.com/users/prajwalpkn/starred{/owner}{/repo}
https://api.github.com/users/prajwalpkn/subscriptions
User
https://api.github.com/users/prajwalpkn
public
MEMBER
Yes `concatenate_datasets` works for datasets loaded in streaming mode as well
2024-04-08T13:26:45Z
https://github.com/huggingface/datasets/issues/2699#issuecomment-2042757941
https://api.github.com/repos/huggingface/datasets/issues/2699
IC_kwDODunzps55wgM1
https://api.github.com/repos/huggingface/datasets/issues/comments/2042757941/reactions
2024-04-08T13:26:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2042757941
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
this does not work:
`dataset = datasets.load_dataset('mc4','iw',split='train+validation',streaming=True)`
with error:
`ValueError: Bad split: train+validation. Available splits: ['train', 'validation']`

these work:
`dataset = datasets.load_dataset('mc4','iw',split='train+validation')`
`dataset = datasets.load_dataset('mc4','iw',split='train',streaming=True)`
`dataset = datasets.load_dataset('mc4','iw',split='validation',streaming=True)`

i could not find a reference to this in the documentation and the error message is confusing. also would be nice to allow streaming for the merged splits