[BUG FIX] Issue 5744
NONE
Have met the same problem with datasets==2.8.0, pandas==2.0.0. It could be solved by installing the latest version of datasets or using datasets==2.8.0, pandas==1.5.3.
2023-04-20T09:48:15Z
https://github.com/huggingface/datasets/pull/5745#issuecomment-1516038677
https://api.github.com/repos/huggingface/datasets/issues/5745
IC_kwDODunzps5aXOoV
https://api.github.com/repos/huggingface/datasets/issues/comments/1516038677/reactions
2023-04-20T09:49:04Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1516038677
https://avatars.githubusercontent.com/u/30338885?v=4
https://api.github.com/users/lmz470244967/events{/privacy}
https://api.github.com/users/lmz470244967/followers
https://api.github.com/users/lmz470244967/following{/other_user}
https://api.github.com/users/lmz470244967/gists{/gist_id}
https://github.com/lmz470244967
lmz470244967
MDQ6VXNlcjMwMzM4ODg1
https://api.github.com/users/lmz470244967/orgs
https://api.github.com/users/lmz470244967/received_events
https://api.github.com/users/lmz470244967/repos
https://api.github.com/users/lmz470244967/starred{/owner}{/repo}
https://api.github.com/users/lmz470244967/subscriptions
User
https://api.github.com/users/lmz470244967
public
MEMBER
Pandas 2.0.0 has removed support to passing `mangle_dupe_cols`.

However, our `datasets` library does not use this parameter: it only passes it to pandas if the user passes it to `load_dataset`.

You should better:
- Either "take steps to stop the use of 'mangle_dupe_cols'" (as it was suggested in the deprecation warning in pandas-1.5.3)
- Or pin pandas (< 2.0.0) in your local requirements file

Please note that from `datasets` library, we don't want to force users to use a specific pandas version. We would like to support users as well:
- that use pandas < 1.5.3
- that use pandas >= 2.0.0 and that do not pass the 'mangle_dupe_cols' parameter
2023-04-20T10:12:05Z
https://github.com/huggingface/datasets/pull/5745#issuecomment-1516073004
https://api.github.com/repos/huggingface/datasets/issues/5745
IC_kwDODunzps5aXXAs
https://api.github.com/repos/huggingface/datasets/issues/comments/1516073004/reactions
2023-04-20T10:15:30Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1516073004
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
MEMBER
`datasets` 2.11 doesn't pass `mangle_dupe_cols` unless the user specifies it indeed, so I think we're fine
2023-04-21T15:22:42Z
https://github.com/huggingface/datasets/pull/5745#issuecomment-1517994836
https://api.github.com/repos/huggingface/datasets/issues/5745
IC_kwDODunzps5aesNU
https://api.github.com/repos/huggingface/datasets/issues/comments/1517994836/reactions
2023-04-21T15:22:42Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1517994836
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
A temporal fix for https://github.com/huggingface/datasets/issues/5744.