Cannot load the cache when mapping the dataset
NONE
@zhangn77 Hi ，have you solved this problem? I encountered the same issue during training. Could we discuss it?
2025-02-24T07:56:47Z
https://github.com/huggingface/datasets/issues/7261#issuecomment-2677661912
https://api.github.com/repos/huggingface/datasets/issues/7261
IC_kwDODunzps6fmeDY
https://api.github.com/repos/huggingface/datasets/issues/comments/2677661912/reactions
2025-02-24T07:56:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2677661912
https://avatars.githubusercontent.com/u/26711776?v=4
https://api.github.com/users/shawn-AI-Tech/events{/privacy}
https://api.github.com/users/shawn-AI-Tech/followers
https://api.github.com/users/shawn-AI-Tech/following{/other_user}
https://api.github.com/users/shawn-AI-Tech/gists{/gist_id}
https://github.com/shawn-AI-Tech
shawn-AI-Tech
MDQ6VXNlcjI2NzExNzc2
https://api.github.com/users/shawn-AI-Tech/orgs
https://api.github.com/users/shawn-AI-Tech/received_events
https://api.github.com/users/shawn-AI-Tech/repos
https://api.github.com/users/shawn-AI-Tech/starred{/owner}{/repo}
https://api.github.com/users/shawn-AI-Tech/subscriptions
User
https://api.github.com/users/shawn-AI-Tech
public
NONE
I also encountered the same problem, why is that？
2025-03-24T13:27:55Z
https://github.com/huggingface/datasets/issues/7261#issuecomment-2748136331
https://api.github.com/repos/huggingface/datasets/issues/7261
IC_kwDODunzps6jzTuL
https://api.github.com/repos/huggingface/datasets/issues/comments/2748136331/reactions
2025-03-24T13:27:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2748136331
https://avatars.githubusercontent.com/u/96232749?v=4
https://api.github.com/users/MtYCNN/events{/privacy}
https://api.github.com/users/MtYCNN/followers
https://api.github.com/users/MtYCNN/following{/other_user}
https://api.github.com/users/MtYCNN/gists{/gist_id}
https://github.com/MtYCNN
MtYCNN
U_kgDOBbxlLQ
https://api.github.com/users/MtYCNN/orgs
https://api.github.com/users/MtYCNN/received_events
https://api.github.com/users/MtYCNN/repos
https://api.github.com/users/MtYCNN/starred{/owner}{/repo}
https://api.github.com/users/MtYCNN/subscriptions
User
https://api.github.com/users/MtYCNN
public
### Describe the bug

I'm training the flux controlnet. The train_dataset.map() takes long time to finish. However, when I killed one training process and want to restart a new training with the same dataset. I can't reuse the mapped result even I defined the cache dir for the dataset.

with accelerator.main_process_first():
        from datasets.fingerprint import Hasher

        # fingerprint used by the cache for the other processes to load the result
        # details: https://github.com/huggingface/diffusers/pull/4038#discussion_r1266078401
        new_fingerprint = Hasher.hash(args)
        train_dataset = train_dataset.map(
            compute_embeddings_fn, batched=True, new_fingerprint=new_fingerprint, batch_size=10,
        )

### Steps to reproduce the bug

train flux controlnet and start again



### Expected behavior

will not map again

### Environment info

latest diffusers

