remove filecheck to enable symlinks
NONE
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/datasets/pr_7133). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
2024-08-30T15:18:37Z
https://github.com/huggingface/datasets/pull/7133#issuecomment-2321586958
https://api.github.com/repos/huggingface/datasets/issues/7133
IC_kwDODunzps6KYJsO
https://api.github.com/repos/huggingface/datasets/issues/comments/2321586958/reactions
2024-08-30T15:18:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2321586958
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
MEMBER
The CI is failing, looks like it breaks imagefolder loading.

I just checked fsspec internals and maybe instead we can detect symlink by checking `islink` and `size` to make sure it's a file
```python
if info["type"] == "file" or (info.get("islink") and info["size"])
```

2024-09-02T16:13:35Z
https://github.com/huggingface/datasets/pull/7133#issuecomment-2325050416
https://api.github.com/repos/huggingface/datasets/issues/7133
IC_kwDODunzps6KlXQw
https://api.github.com/repos/huggingface/datasets/issues/comments/2325050416/reactions
2024-09-02T16:13:35Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2325050416
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
hmm actually `size` doesn't seem to filter symlinked directories, we need another way
2024-09-02T16:15:57Z
https://github.com/huggingface/datasets/pull/7133#issuecomment-2325053250
https://api.github.com/repos/huggingface/datasets/issues/7133
IC_kwDODunzps6KlX9C
https://api.github.com/repos/huggingface/datasets/issues/comments/2325053250/reactions
2024-09-02T16:15:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2325053250
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
Does fsspec perhaps allow resolving symlinks? Something like https://docs.python.org/3/library/pathlib.html#pathlib.Path.resolve
2024-09-03T07:13:55Z
https://github.com/huggingface/datasets/pull/7133#issuecomment-2325768630
https://api.github.com/repos/huggingface/datasets/issues/7133
IC_kwDODunzps6KoGm2
https://api.github.com/repos/huggingface/datasets/issues/comments/2325768630/reactions
2024-09-03T07:13:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2325768630
https://avatars.githubusercontent.com/u/23191892?v=4
https://api.github.com/users/fschlatt/events{/privacy}
https://api.github.com/users/fschlatt/followers
https://api.github.com/users/fschlatt/following{/other_user}
https://api.github.com/users/fschlatt/gists{/gist_id}
https://github.com/fschlatt
fschlatt
MDQ6VXNlcjIzMTkxODky
https://api.github.com/users/fschlatt/orgs
https://api.github.com/users/fschlatt/received_events
https://api.github.com/users/fschlatt/repos
https://api.github.com/users/fschlatt/starred{/owner}{/repo}
https://api.github.com/users/fschlatt/subscriptions
User
https://api.github.com/users/fschlatt
public
MEMBER
there is `info["destination"]` in case of a symlink, so maybe


```python
if info["type"] == "file" or (info.get("islink") and info.get("destination") and os.path.isfile(info["destination"]))
```
2024-09-04T12:46:54Z
https://github.com/huggingface/datasets/pull/7133#issuecomment-2328915365
https://api.github.com/repos/huggingface/datasets/issues/7133
IC_kwDODunzps6K0G2l
https://api.github.com/repos/huggingface/datasets/issues/comments/2328915365/reactions
2024-09-04T12:46:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2328915365
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
I've added a fix which works with some temporary test files locally 

`(info["type"] == "file" or (info.get("islink") and os.path.isfile(os.path.realpath(filepath))))`
2024-12-21T12:35:17Z
https://github.com/huggingface/datasets/pull/7133#issuecomment-2558107953
https://api.github.com/repos/huggingface/datasets/issues/7133
IC_kwDODunzps6YeaEx
https://api.github.com/repos/huggingface/datasets/issues/comments/2558107953/reactions
2024-12-21T12:35:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2558107953
https://avatars.githubusercontent.com/u/23191892?v=4
https://api.github.com/users/fschlatt/events{/privacy}
https://api.github.com/users/fschlatt/followers
https://api.github.com/users/fschlatt/following{/other_user}
https://api.github.com/users/fschlatt/gists{/gist_id}
https://github.com/fschlatt
fschlatt
MDQ6VXNlcjIzMTkxODky
https://api.github.com/users/fschlatt/orgs
https://api.github.com/users/fschlatt/received_events
https://api.github.com/users/fschlatt/repos
https://api.github.com/users/fschlatt/starred{/owner}{/repo}
https://api.github.com/users/fschlatt/subscriptions
User
https://api.github.com/users/fschlatt
public
Enables streaming from local symlinks #7083 

@lhoestq