load_from_disk
NONE
Hello, It's an interesting issue here. I have the same problem, I have a local dataset and I want to push the dataset to the hub but huggingface does a copy of it.

```py
from datasets import load_dataset

dataset = load_dataset("webdataset", data_files="/media/works/data/*.tar") # copy here
dataset.push_to_hub("WaveGenAI/audios2")
```

Edit: I can use HfApi for my use case

2024-10-31T14:35:26Z
https://github.com/huggingface/datasets/issues/7268#issuecomment-2450046154
https://api.github.com/repos/huggingface/datasets/issues/7268
IC_kwDODunzps6SCLzK
https://api.github.com/repos/huggingface/datasets/issues/comments/2450046154/reactions
2024-10-31T14:43:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2450046154
https://avatars.githubusercontent.com/u/64205064?v=4
https://api.github.com/users/Jourdelune/events{/privacy}
https://api.github.com/users/Jourdelune/followers
https://api.github.com/users/Jourdelune/following{/other_user}
https://api.github.com/users/Jourdelune/gists{/gist_id}
https://github.com/Jourdelune
Jourdelune
MDQ6VXNlcjY0MjA1MDY0
https://api.github.com/users/Jourdelune/orgs
https://api.github.com/users/Jourdelune/received_events
https://api.github.com/users/Jourdelune/repos
https://api.github.com/users/Jourdelune/starred{/owner}{/repo}
https://api.github.com/users/Jourdelune/subscriptions
User
https://api.github.com/users/Jourdelune
public
NONE
Is there any update on this issue? I found the same behavior too.
My datasets version is `2.13.2`
2025-07-01T06:41:13Z
https://github.com/huggingface/datasets/issues/7268#issuecomment-3022087552
https://api.github.com/repos/huggingface/datasets/issues/7268
IC_kwDODunzps60IWWA
https://api.github.com/repos/huggingface/datasets/issues/comments/3022087552/reactions
2025-07-01T06:41:13Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3022087552
https://avatars.githubusercontent.com/u/108246916?v=4
https://api.github.com/users/Macchiatobin/events{/privacy}
https://api.github.com/users/Macchiatobin/followers
https://api.github.com/users/Macchiatobin/following{/other_user}
https://api.github.com/users/Macchiatobin/gists{/gist_id}
https://github.com/Macchiatobin
Macchiatobin
U_kgDOBnO3hA
https://api.github.com/users/Macchiatobin/orgs
https://api.github.com/users/Macchiatobin/received_events
https://api.github.com/users/Macchiatobin/repos
https://api.github.com/users/Macchiatobin/starred{/owner}{/repo}
https://api.github.com/users/Macchiatobin/subscriptions
User
https://api.github.com/users/Macchiatobin
public
NONE
Updating to the newest version of datasets lib resolved the issue. 
2025-07-01T08:42:17Z
https://github.com/huggingface/datasets/issues/7268#issuecomment-3022710694
https://api.github.com/repos/huggingface/datasets/issues/7268
IC_kwDODunzps60Kuem
https://api.github.com/repos/huggingface/datasets/issues/comments/3022710694/reactions
2025-07-01T08:42:17Z
https://api.github.com/repos/huggingface/datasets/issues/comments/3022710694
https://avatars.githubusercontent.com/u/71670961?v=4
https://api.github.com/users/ghaith-mq/events{/privacy}
https://api.github.com/users/ghaith-mq/followers
https://api.github.com/users/ghaith-mq/following{/other_user}
https://api.github.com/users/ghaith-mq/gists{/gist_id}
https://github.com/ghaith-mq
ghaith-mq
MDQ6VXNlcjcxNjcwOTYx
https://api.github.com/users/ghaith-mq/orgs
https://api.github.com/users/ghaith-mq/received_events
https://api.github.com/users/ghaith-mq/repos
https://api.github.com/users/ghaith-mq/starred{/owner}{/repo}
https://api.github.com/users/ghaith-mq/subscriptions
User
https://api.github.com/users/ghaith-mq
public
### Describe the bug

I have data saved with save_to_disk. The data is big (700Gb). When I try loading it, the only option is load_from_disk, and this function copies the data to a tmp directory, causing me to run out of disk space. Is there an alternative solution to that?

### Steps to reproduce the bug

when trying to load data using load_From_disk after being saved using save_to_disk 

### Expected behavior

run out of disk space

### Environment info

lateest version