resume_download with streaming=True
COLLABORATOR
Currently, it's not possible to efficiently resume streaming after an error. Eventually, we plan to support this for Parquet (see https://github.com/huggingface/datasets/issues/5380). 
2023-07-26T15:35:24Z
https://github.com/huggingface/datasets/issues/6078#issuecomment-1652061662
https://api.github.com/repos/huggingface/datasets/issues/6078
IC_kwDODunzps5ieHXe
https://api.github.com/repos/huggingface/datasets/issues/comments/1652061662/reactions
2023-07-26T15:35:24Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1652061662
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
Ok thank you for your answer
2023-07-26T21:10:39Z
https://github.com/huggingface/datasets/issues/6078#issuecomment-1652500244
https://api.github.com/repos/huggingface/datasets/issues/6078
IC_kwDODunzps5ifycU
https://api.github.com/repos/huggingface/datasets/issues/comments/1652500244/reactions
2023-07-26T21:10:39Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1652500244
https://avatars.githubusercontent.com/u/72763959?v=4
https://api.github.com/users/NicolasMICAUX/events{/privacy}
https://api.github.com/users/NicolasMICAUX/followers
https://api.github.com/users/NicolasMICAUX/following{/other_user}
https://api.github.com/users/NicolasMICAUX/gists{/gist_id}
https://github.com/NicolasMICAUX
NicolasMICAUX
MDQ6VXNlcjcyNzYzOTU5
https://api.github.com/users/NicolasMICAUX/orgs
https://api.github.com/users/NicolasMICAUX/received_events
https://api.github.com/users/NicolasMICAUX/repos
https://api.github.com/users/NicolasMICAUX/starred{/owner}{/repo}
https://api.github.com/users/NicolasMICAUX/subscriptions
User
https://api.github.com/users/NicolasMICAUX
public
COLLABORATOR
I'm closing this as a duplicate of #5380
2023-07-28T11:05:03Z
https://github.com/huggingface/datasets/issues/6078#issuecomment-1655500481
https://api.github.com/repos/huggingface/datasets/issues/6078
IC_kwDODunzps5irO7B
https://api.github.com/repos/huggingface/datasets/issues/comments/1655500481/reactions
2023-07-28T11:05:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1655500481
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
### Describe the bug

I used:
```
dataset = load_dataset(
    "oscar-corpus/OSCAR-2201",
    token=True,
    language="fr",
    streaming=True,
    split="train"
)
```
Unfortunately, the server had a problem during the training process. I saved the step my training stopped at.
But how can I resume download from step 1_000_´000 without re-streaming all the first 1 million docs of the dataset?

`download_config=DownloadConfig(resume_download=True)` seems to not work with streaming=True.

### Steps to reproduce the bug

```
from datasets import load_dataset, DownloadConfig
dataset = load_dataset(
    "oscar-corpus/OSCAR-2201",
    token=True,
    language="fr",
    streaming=True,  # optional
    split="train",
    download_config=DownloadConfig(resume_download=True)
)
# interupt the run and try to relaunch it => this restart from scratch
```

### Expected behavior

I would expect a parameter to start streaming from a given index in the dataset.

### Environment info

- `datasets` version: 2.14.0
- Platform: Linux-5.19.0-45-generic-x86_64-with-glibc2.29
- Python version: 3.8.10
- Huggingface_hub version: 0.15.1
- PyArrow version: 12.0.1
- Pandas version: 2.0.0