`drop_duplicates` method
CONTRIBUTOR
There is an open issue #2514 about this which also proposes solutions.
2024-07-02T13:54:48Z
https://github.com/huggingface/datasets/issues/7016#issuecomment-2203252552
https://api.github.com/repos/huggingface/datasets/issues/7016
IC_kwDODunzps6DUvdI
https://api.github.com/repos/huggingface/datasets/issues/comments/2203252552/reactions
2024-07-02T13:54:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/2203252552
https://avatars.githubusercontent.com/u/8976546?v=4
https://api.github.com/users/Dref360/events{/privacy}
https://api.github.com/users/Dref360/followers
https://api.github.com/users/Dref360/following{/other_user}
https://api.github.com/users/Dref360/gists{/gist_id}
https://github.com/Dref360
Dref360
MDQ6VXNlcjg5NzY1NDY=
https://api.github.com/users/Dref360/orgs
https://api.github.com/users/Dref360/received_events
https://api.github.com/users/Dref360/repos
https://api.github.com/users/Dref360/starred{/owner}{/repo}
https://api.github.com/users/Dref360/subscriptions
User
https://api.github.com/users/Dref360
public
### Feature request

`drop_duplicates` method for huggingface datasets (similiar in simplicity to the `pandas` one)

### Motivation

Ease of use

### Your contribution

I don't think i am good enough to help