Use prefix to allow exceed Windows MAX_PATH
COLLABORATOR
Does this mean the `FileNotFoundError` that avoids infinite loop can be removed?
2021-07-12T01:05:29Z
https://github.com/huggingface/datasets/pull/2621#issuecomment-877898223
https://api.github.com/repos/huggingface/datasets/issues/2621
MDEyOklzc3VlQ29tbWVudDg3Nzg5ODIyMw==
https://api.github.com/repos/huggingface/datasets/issues/comments/877898223/reactions
2021-07-12T01:05:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/877898223
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
MEMBER
Yes, I think so...
2021-07-12T05:51:16Z
https://github.com/huggingface/datasets/pull/2621#issuecomment-877991382
https://api.github.com/repos/huggingface/datasets/issues/2621
MDEyOklzc3VlQ29tbWVudDg3Nzk5MTM4Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/877991382/reactions
2021-07-12T05:51:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/877991382
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
Or maybe we could leave it in case a relative path exceeds the MAX_PATH limit?
2021-07-12T09:50:48Z
https://github.com/huggingface/datasets/pull/2621#issuecomment-878136524
https://api.github.com/repos/huggingface/datasets/issues/2621
MDEyOklzc3VlQ29tbWVudDg3ODEzNjUyNA==
https://api.github.com/repos/huggingface/datasets/issues/comments/878136524/reactions
2021-07-12T09:51:03Z
https://api.github.com/repos/huggingface/datasets/issues/comments/878136524
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
COLLABORATOR
 > Or maybe we could leave it in case a relative path exceeds the MAX_PATH limit?

What about converting relative paths to absolute?
2021-07-12T22:59:48Z
https://github.com/huggingface/datasets/pull/2621#issuecomment-878651549
https://api.github.com/repos/huggingface/datasets/issues/2621
MDEyOklzc3VlQ29tbWVudDg3ODY1MTU0OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/878651549/reactions
2021-07-12T22:59:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/878651549
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
MEMBER
Nice ! Have you had a chance to test it on a windows machine with the max path limit enabled ? Afaik the CI doesn't have the path limit
2021-07-15T09:49:57Z
https://github.com/huggingface/datasets/pull/2621#issuecomment-880557799
https://api.github.com/repos/huggingface/datasets/issues/2621
MDEyOklzc3VlQ29tbWVudDg4MDU1Nzc5OQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/880557799/reactions
2021-07-15T09:49:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/880557799
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Sure @lhoestq: I've tested on my machine... And this fixes most of the tests... 😅 
2021-07-15T13:47:57Z
https://github.com/huggingface/datasets/pull/2621#issuecomment-880709237
https://api.github.com/repos/huggingface/datasets/issues/2621
MDEyOklzc3VlQ29tbWVudDg4MDcwOTIzNw==
https://api.github.com/repos/huggingface/datasets/issues/comments/880709237/reactions
2021-07-15T13:47:57Z
https://api.github.com/repos/huggingface/datasets/issues/comments/880709237
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
By using this prefix, you can exceed the Windows MAX_PATH limit.

See: https://docs.microsoft.com/en-us/windows/win32/fileio/naming-a-file?redirectedfrom=MSDN#win32-file-namespaces

Related to #2524, #2220.