[FSTimeoutError] load_dataset
NONE
Is this `FSTimeoutError` due to download network issue from remote resource (from where it is being accessed)?
2024-09-26T15:57:25Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2377360692
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6Ns6U0
https://api.github.com/repos/huggingface/datasets/issues/comments/2377360692/reactions
2024-09-26T15:57:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2377360692
https://avatars.githubusercontent.com/u/53268607?v=4
https://api.github.com/users/cosmo3769/events{/privacy}
https://api.github.com/users/cosmo3769/followers
https://api.github.com/users/cosmo3769/following{/other_user}
https://api.github.com/users/cosmo3769/gists{/gist_id}
https://github.com/cosmo3769
cosmo3769
MDQ6VXNlcjUzMjY4NjA3
https://api.github.com/users/cosmo3769/orgs
https://api.github.com/users/cosmo3769/received_events
https://api.github.com/users/cosmo3769/repos
https://api.github.com/users/cosmo3769/starred{/owner}{/repo}
https://api.github.com/users/cosmo3769/subscriptions
User
https://api.github.com/users/cosmo3769
public
NONE
It seems to happen for all datasets, not just a specific one, and especially for versions after 3.0. (3.0.0, 3.0.1 have this problem)

I had the same error on a different dataset, but after downgrading to datasets==2.21.0, the problem was solved.
2024-09-27T12:15:50Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2379137664
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6NzsKA
https://api.github.com/repos/huggingface/datasets/issues/comments/2379137664/reactions
2024-09-27T12:15:50Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2379137664
https://avatars.githubusercontent.com/u/76243689?v=4
https://api.github.com/users/crlotwhite/events{/privacy}
https://api.github.com/users/crlotwhite/followers
https://api.github.com/users/crlotwhite/following{/other_user}
https://api.github.com/users/crlotwhite/gists{/gist_id}
https://github.com/crlotwhite
crlotwhite
MDQ6VXNlcjc2MjQzNjg5
https://api.github.com/users/crlotwhite/orgs
https://api.github.com/users/crlotwhite/received_events
https://api.github.com/users/crlotwhite/repos
https://api.github.com/users/crlotwhite/starred{/owner}{/repo}
https://api.github.com/users/crlotwhite/subscriptions
User
https://api.github.com/users/crlotwhite
public
MEMBER
Same as https://github.com/huggingface/datasets/issues/7164

This dataset is made of a python script that downloads data from elsewhere than HF, so availability depends on the original host. Ultimately it would be nice to host the files of this dataset on HF

in `datasets` <3.0 there were lots of mechanisms that got removed after the decision to make datasets with python loading scripts legacy for security and maintenance reasons (we only do very basic support now)
2024-09-30T10:30:21Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2382735872
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6OBaoA
https://api.github.com/repos/huggingface/datasets/issues/comments/2382735872/reactions
2024-09-30T10:32:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2382735872
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
@lhoestq Thank you for the clarification! Closing the issue.
2024-09-30T17:28:35Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2383774372
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6OFYKk
https://api.github.com/repos/huggingface/datasets/issues/comments/2383774372/reactions
2024-09-30T17:28:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2383774372
https://avatars.githubusercontent.com/u/53268607?v=4
https://api.github.com/users/cosmo3769/events{/privacy}
https://api.github.com/users/cosmo3769/followers
https://api.github.com/users/cosmo3769/following{/other_user}
https://api.github.com/users/cosmo3769/gists{/gist_id}
https://github.com/cosmo3769
cosmo3769
MDQ6VXNlcjUzMjY4NjA3
https://api.github.com/users/cosmo3769/orgs
https://api.github.com/users/cosmo3769/received_events
https://api.github.com/users/cosmo3769/repos
https://api.github.com/users/cosmo3769/starred{/owner}{/repo}
https://api.github.com/users/cosmo3769/subscriptions
User
https://api.github.com/users/cosmo3769
public
NONE
I'm getting this too, and also at 5 minutes.  But for `CSTR-Edinburgh/vctk`, so it's not just this dataset, it seems to be a timeout that was introduced and needs to be raised.  The progress bar was moving along just fine before the timeout, and I get more or less of it depending on how fast the network is.
2024-10-23T19:07:20Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2433219288
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6RB_rY
https://api.github.com/repos/huggingface/datasets/issues/comments/2433219288/reactions
2024-10-23T19:07:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2433219288
https://avatars.githubusercontent.com/u/4621169?v=4
https://api.github.com/users/Epiphero/events{/privacy}
https://api.github.com/users/Epiphero/followers
https://api.github.com/users/Epiphero/following{/other_user}
https://api.github.com/users/Epiphero/gists{/gist_id}
https://github.com/Epiphero
Epiphero
MDQ6VXNlcjQ2MjExNjk=
https://api.github.com/users/Epiphero/orgs
https://api.github.com/users/Epiphero/received_events
https://api.github.com/users/Epiphero/repos
https://api.github.com/users/Epiphero/starred{/owner}{/repo}
https://api.github.com/users/Epiphero/subscriptions
User
https://api.github.com/users/Epiphero
public
CONTRIBUTOR
You can change the `aiohttp` timeout from 5min to 1h like this:

```python
import datasets, aiohttp
dataset = datasets.load_dataset(
    dataset_name,
    storage_options={'client_kwargs': {'timeout': aiohttp.ClientTimeout(total=3600)}}
)
```
2024-10-26T16:12:56Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2439636770
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6Raeci
https://api.github.com/repos/huggingface/datasets/issues/comments/2439636770/reactions
2024-10-26T16:12:56Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2439636770
https://avatars.githubusercontent.com/u/33965649?v=4
https://api.github.com/users/JonasLoos/events{/privacy}
https://api.github.com/users/JonasLoos/followers
https://api.github.com/users/JonasLoos/following{/other_user}
https://api.github.com/users/JonasLoos/gists{/gist_id}
https://github.com/JonasLoos
JonasLoos
MDQ6VXNlcjMzOTY1NjQ5
https://api.github.com/users/JonasLoos/orgs
https://api.github.com/users/JonasLoos/received_events
https://api.github.com/users/JonasLoos/repos
https://api.github.com/users/JonasLoos/starred{/owner}{/repo}
https://api.github.com/users/JonasLoos/subscriptions
User
https://api.github.com/users/JonasLoos
public
NONE
@JonasLoos Solution solved a download timeout error I received when downloading  `"HuggingFaceM4/VQAv2"` 🎉 
2025-02-01T09:09:23Z
https://github.com/huggingface/datasets/issues/7175#issuecomment-2628868000
https://api.github.com/repos/huggingface/datasets/issues/7175
IC_kwDODunzps6csVeg
https://api.github.com/repos/huggingface/datasets/issues/comments/2628868000/reactions
2025-02-01T09:09:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2628868000
https://avatars.githubusercontent.com/u/22105494?v=4
https://api.github.com/users/tomasruizt/events{/privacy}
https://api.github.com/users/tomasruizt/followers
https://api.github.com/users/tomasruizt/following{/other_user}
https://api.github.com/users/tomasruizt/gists{/gist_id}
https://github.com/tomasruizt
tomasruizt
MDQ6VXNlcjIyMTA1NDk0
https://api.github.com/users/tomasruizt/orgs
https://api.github.com/users/tomasruizt/received_events
https://api.github.com/users/tomasruizt/repos
https://api.github.com/users/tomasruizt/starred{/owner}{/repo}
https://api.github.com/users/tomasruizt/subscriptions
User
https://api.github.com/users/tomasruizt
public
### Describe the bug

When using `load_dataset`to load [HuggingFaceM4/VQAv2](https://huggingface.co/datasets/HuggingFaceM4/VQAv2), I am getting `FSTimeoutError`. 

### Error

```
TimeoutError: 

The above exception was the direct cause of the following exception:

FSTimeoutError                            Traceback (most recent call last)
[/usr/local/lib/python3.10/dist-packages/fsspec/asyn.py](https://klh9mr78js-496ff2e9c6d22116-0-colab.googleusercontent.com/outputframe.html?vrz=colab_20240924-060116_RC00_678132060#) in sync(loop, func, timeout, *args, **kwargs)
     99     if isinstance(return_result, asyncio.TimeoutError):
    100         # suppress asyncio.TimeoutError, raise FSTimeoutError
--> 101         raise FSTimeoutError from return_result
    102     elif isinstance(return_result, BaseException):
    103         raise return_result

FSTimeoutError:
```

It usually fails around 5-6 GB.

<img width="847" alt="Screenshot 2024-09-26 at 9 10 19 PM" src="https://github.com/user-attachments/assets/ff91995a-fb55-4de6-8214-94025d6c8470">


### Steps to reproduce the bug

To reproduce it, run this in colab notebook:

```
!pip install -q -U datasets

from datasets import load_dataset
ds = load_dataset('HuggingFaceM4/VQAv2', split="train[:10%]")
```



### Expected behavior

It should download properly.

### Environment info

Using Colab Notebook.