Consistent metric outputs
MEMBER
I keep this PR in stand-by for next week's datasets sprint. If the next release is 2.0.0 then we can include it given that it's breaking for many metrics
2020-11-26T17:30:54Z
https://github.com/huggingface/datasets/pull/868#issuecomment-734417672
https://api.github.com/repos/huggingface/datasets/issues/868
MDEyOklzc3VlQ29tbWVudDczNDQxNzY3Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/734417672/reactions
2020-11-26T17:32:27Z
https://api.github.com/repos/huggingface/datasets/issues/comments/734417672
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
Metrics are deprecated in `datasets` and `evaluate` should be used instead: https://github.com/huggingface/evaluate
2023-07-11T09:35:52Z
https://github.com/huggingface/datasets/pull/868#issuecomment-1630488003
https://api.github.com/repos/huggingface/datasets/issues/868
IC_kwDODunzps5hL0XD
https://api.github.com/repos/huggingface/datasets/issues/comments/1630488003/reactions
2023-07-11T09:35:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1630488003
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
To automate the use of metrics, they should return consistent outputs.
In particular I'm working on adding a conversion of metrics to keras metrics.
To achieve this we need two things:
- have each metric return dictionaries of string -> floats since each keras metrics should return one float
- define in the metric info the different fields of the output dictionary

In this PR I'm adding these two features.
I also fixed a few bugs in some metrics

#867 needs to be merged first