Add FrugalScore metric
CONTRIBUTOR
@lhoestq 

The model used by default (`moussaKam/frugalscore_tiny_bert-base_bert-score`) is a tiny model.

I still want to make one modification before merging.
I would like to load the model checkpoint once. Do you think it's a good idea if I load it in `_download_and_prepare`? In this case should the model name be the `self.config_name` or another variable say `self.model_name` ? 
2022-02-08T10:36:55Z
https://github.com/huggingface/datasets/pull/3674#issuecomment-1032459718
https://api.github.com/repos/huggingface/datasets/issues/3674
IC_kwDODunzps49ihXG
https://api.github.com/repos/huggingface/datasets/issues/comments/1032459718/reactions
2022-02-08T10:36:55Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1032459718
https://avatars.githubusercontent.com/u/28675016?v=4
https://api.github.com/users/moussaKam/events{/privacy}
https://api.github.com/users/moussaKam/followers
https://api.github.com/users/moussaKam/following{/other_user}
https://api.github.com/users/moussaKam/gists{/gist_id}
https://github.com/moussaKam
moussaKam
MDQ6VXNlcjI4Njc1MDE2
https://api.github.com/users/moussaKam/orgs
https://api.github.com/users/moussaKam/received_events
https://api.github.com/users/moussaKam/repos
https://api.github.com/users/moussaKam/starred{/owner}{/repo}
https://api.github.com/users/moussaKam/subscriptions
User
https://api.github.com/users/moussaKam
public
CONTRIBUTOR
OK, I added a commit that loads the checkpoint in `_download_and_prepare`. Please let me know if it looks good. 
2022-02-08T11:56:52Z
https://github.com/huggingface/datasets/pull/3674#issuecomment-1032528400
https://api.github.com/repos/huggingface/datasets/issues/3674
IC_kwDODunzps49iyIQ
https://api.github.com/repos/huggingface/datasets/issues/comments/1032528400/reactions
2022-02-08T11:57:07Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1032528400
https://avatars.githubusercontent.com/u/28675016?v=4
https://api.github.com/users/moussaKam/events{/privacy}
https://api.github.com/users/moussaKam/followers
https://api.github.com/users/moussaKam/following{/other_user}
https://api.github.com/users/moussaKam/gists{/gist_id}
https://github.com/moussaKam
moussaKam
MDQ6VXNlcjI4Njc1MDE2
https://api.github.com/users/moussaKam/orgs
https://api.github.com/users/moussaKam/received_events
https://api.github.com/users/moussaKam/repos
https://api.github.com/users/moussaKam/starred{/owner}{/repo}
https://api.github.com/users/moussaKam/subscriptions
User
https://api.github.com/users/moussaKam
public
CONTRIBUTOR
@lhoestq is everything OK to merge? 
2022-02-14T11:08:40Z
https://github.com/huggingface/datasets/pull/3674#issuecomment-1038953955
https://api.github.com/repos/huggingface/datasets/issues/3674
IC_kwDODunzps497S3j
https://api.github.com/repos/huggingface/datasets/issues/comments/1038953955/reactions
2022-02-14T11:08:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1038953955
https://avatars.githubusercontent.com/u/28675016?v=4
https://api.github.com/users/moussaKam/events{/privacy}
https://api.github.com/users/moussaKam/followers
https://api.github.com/users/moussaKam/following{/other_user}
https://api.github.com/users/moussaKam/gists{/gist_id}
https://github.com/moussaKam
moussaKam
MDQ6VXNlcjI4Njc1MDE2
https://api.github.com/users/moussaKam/orgs
https://api.github.com/users/moussaKam/received_events
https://api.github.com/users/moussaKam/repos
https://api.github.com/users/moussaKam/starred{/owner}{/repo}
https://api.github.com/users/moussaKam/subscriptions
User
https://api.github.com/users/moussaKam
public
MEMBER
I triggered the CI and it's failing, can you merge the `master` branch into yours ? It should fix the issues.

Also the doctest apparently raises an error because it outputs `{'scores': [0.6307542, 0.6449357]}` instead of `{'scores': [0.631, 0.645]}` - feel free to edit the code example in the docstring to round the scores, that should fix it
2022-02-18T17:45:52Z
https://github.com/huggingface/datasets/pull/3674#issuecomment-1044906863
https://api.github.com/repos/huggingface/datasets/issues/3674
IC_kwDODunzps4-SANv
https://api.github.com/repos/huggingface/datasets/issues/comments/1044906863/reactions
2022-02-18T17:45:52Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1044906863
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
@lhoestq hope it's OK now
2022-02-21T10:27:21Z
https://github.com/huggingface/datasets/pull/3674#issuecomment-1046717648
https://api.github.com/repos/huggingface/datasets/issues/3674
IC_kwDODunzps4-Y6TQ
https://api.github.com/repos/huggingface/datasets/issues/comments/1046717648/reactions
2022-02-21T10:27:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1046717648
https://avatars.githubusercontent.com/u/28675016?v=4
https://api.github.com/users/moussaKam/events{/privacy}
https://api.github.com/users/moussaKam/followers
https://api.github.com/users/moussaKam/following{/other_user}
https://api.github.com/users/moussaKam/gists{/gist_id}
https://github.com/moussaKam
moussaKam
MDQ6VXNlcjI4Njc1MDE2
https://api.github.com/users/moussaKam/orgs
https://api.github.com/users/moussaKam/received_events
https://api.github.com/users/moussaKam/repos
https://api.github.com/users/moussaKam/starred{/owner}{/repo}
https://api.github.com/users/moussaKam/subscriptions
User
https://api.github.com/users/moussaKam
public
This pull request add FrugalScore metric for NLG systems evaluation.

FrugalScore is a reference-based metric for NLG models evaluation. It is based on a distillation approach that allows to learn a fixed, low cost version of any expensive NLG metric, while retaining most of its original performance.

Paper: https://arxiv.org/abs/2110.08559?context=cs
Github: https://github.com/moussaKam/FrugalScore

@lhoestq 