Directly reading parquet files in a s3 bucket from the load_dataset method
MEMBER
Hi ! I think is in the scope of this other issue: to https://github.com/huggingface/datasets/issues/5281 
2023-02-23T11:02:55Z
https://github.com/huggingface/datasets/issues/5566#issuecomment-1441563981
https://api.github.com/repos/huggingface/datasets/issues/5566
IC_kwDODunzps5V7IVN
https://api.github.com/repos/huggingface/datasets/issues/comments/1441563981/reactions
2023-02-23T11:02:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1441563981
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
### Feature request

Right now, we have to read the get the parquet file to the local storage. So having ability to read given the bucket directly address would be benificial 

### Motivation

In a production set up, this feature can help us a lot. So we do not need move training datafiles in between storage.  

### Your contribution

I am willing to help if there's anyway. 