Does datasets support load text from HDFS?
MEMBER
Hi ! `datasets` currently supports reading local files or files over HTTP. We may add support for other filesystems (cloud storages, hdfs...) at one point though :)
2022-01-05T15:10:10Z
https://github.com/huggingface/datasets/issues/3490#issuecomment-1005769301
https://api.github.com/repos/huggingface/datasets/issues/3490
IC_kwDODunzps478tJV
https://api.github.com/repos/huggingface/datasets/issues/comments/1005769301/reactions
2022-01-05T15:10:10Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1005769301
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
The raw text data is stored on HDFS due to the dataset's size is too large to store on my develop machine, 
so I wander does datasets support read data from hdfs?