`load_dataset` caches two arrow files?
MEMBER
Hi ! Files that starts with `cache-*` are cached computation files, i.e. they are the cached results of map/filter/cast/etc. operations. For example if you used `map` on your dataset to transform it, then the resulting dataset is going to be stored and cached in a `cache-*` file. These files are used to avoid having to load the dataset in RAM, even after many transforms
2021-04-09T10:06:34Z
https://github.com/huggingface/datasets/issues/2196#issuecomment-816575341
https://api.github.com/repos/huggingface/datasets/issues/2196
MDEyOklzc3VlQ29tbWVudDgxNjU3NTM0MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/816575341/reactions
2021-04-09T10:06:34Z
https://api.github.com/repos/huggingface/datasets/issues/comments/816575341
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Thanks @lhoestq! Hmm.. that's strange because I specifically turned off auto caching, and saved mapped result, using `save_to_disk`, to another location. At this location, the following file is created:`355G	cache-ed205e500a7dc44c.arrow`

To my observation, both `load_dataset` and `map` creates `cache-*` files, and I wonder what the `cache-*` file from `load_dataset` is for (as I believe the same information is stored in `json-train.arrow`.
2021-04-09T10:14:45Z
https://github.com/huggingface/datasets/issues/2196#issuecomment-816579665
https://api.github.com/repos/huggingface/datasets/issues/2196
MDEyOklzc3VlQ29tbWVudDgxNjU3OTY2NQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/816579665/reactions
2021-04-09T10:14:45Z
https://api.github.com/repos/huggingface/datasets/issues/comments/816579665
https://avatars.githubusercontent.com/u/29157715?v=4
https://api.github.com/users/hwijeen/events{/privacy}
https://api.github.com/users/hwijeen/followers
https://api.github.com/users/hwijeen/following{/other_user}
https://api.github.com/users/hwijeen/gists{/gist_id}
https://github.com/hwijeen
hwijeen
MDQ6VXNlcjI5MTU3NzE1
https://api.github.com/users/hwijeen/orgs
https://api.github.com/users/hwijeen/received_events
https://api.github.com/users/hwijeen/repos
https://api.github.com/users/hwijeen/starred{/owner}{/repo}
https://api.github.com/users/hwijeen/subscriptions
User
https://api.github.com/users/hwijeen
public
NONE
This is a wrong report -- `cache-*` files are created only my `map`, not by `load_dataset`. 
2021-04-12T05:25:29Z
https://github.com/huggingface/datasets/issues/2196#issuecomment-817490997
https://api.github.com/repos/huggingface/datasets/issues/2196
MDEyOklzc3VlQ29tbWVudDgxNzQ5MDk5Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/817490997/reactions
2021-04-12T05:25:29Z
https://api.github.com/repos/huggingface/datasets/issues/comments/817490997
https://avatars.githubusercontent.com/u/29157715?v=4
https://api.github.com/users/hwijeen/events{/privacy}
https://api.github.com/users/hwijeen/followers
https://api.github.com/users/hwijeen/following{/other_user}
https://api.github.com/users/hwijeen/gists{/gist_id}
https://github.com/hwijeen
hwijeen
MDQ6VXNlcjI5MTU3NzE1
https://api.github.com/users/hwijeen/orgs
https://api.github.com/users/hwijeen/received_events
https://api.github.com/users/hwijeen/repos
https://api.github.com/users/hwijeen/starred{/owner}{/repo}
https://api.github.com/users/hwijeen/subscriptions
User
https://api.github.com/users/hwijeen
public
Hi,

I am using datasets to load large json file of 587G.
I checked the cached folder and found that there are two arrow files created:
* `cache-ed205e500a7dc44c.arrow` - 355G
*  `json-train.arrow` - 582G

Why is the first file created?
If I delete it, would I still be able to `load_from_disk`?