Update Dataset.dataset_size after transformed with map
CONTRIBUTOR
@albertvillanova I would like to take this up. It would be great if you could point me as to how the dataset size is calculated in HF. Thanks!
2021-04-20T14:22:05Z
https://github.com/huggingface/datasets/issues/2237#issuecomment-823315432
https://api.github.com/repos/huggingface/datasets/issues/2237
MDEyOklzc3VlQ29tbWVudDgyMzMxNTQzMg==
https://api.github.com/repos/huggingface/datasets/issues/comments/823315432/reactions
2021-04-20T14:22:05Z
https://api.github.com/repos/huggingface/datasets/issues/comments/823315432
https://avatars.githubusercontent.com/u/42388668?v=4
https://api.github.com/users/NikhilBartwal/events{/privacy}
https://api.github.com/users/NikhilBartwal/followers
https://api.github.com/users/NikhilBartwal/following{/other_user}
https://api.github.com/users/NikhilBartwal/gists{/gist_id}
https://github.com/NikhilBartwal
NikhilBartwal
MDQ6VXNlcjQyMzg4NjY4
https://api.github.com/users/NikhilBartwal/orgs
https://api.github.com/users/NikhilBartwal/received_events
https://api.github.com/users/NikhilBartwal/repos
https://api.github.com/users/NikhilBartwal/starred{/owner}{/repo}
https://api.github.com/users/NikhilBartwal/subscriptions
User
https://api.github.com/users/NikhilBartwal
public
After loading a dataset, if we transform it by using `.map` its `dataset_size` attirbute is not updated.