use_custom_baseline still produces errors for bertscore
MEMBER
Thanks for reporting ! That's a bug indeed
If you want to contribute, feel free to fix this issue and open a PR :)
2020-11-12T23:24:18Z
https://github.com/huggingface/datasets/issues/843#issuecomment-726402571
https://api.github.com/repos/huggingface/datasets/issues/843
MDEyOklzc3VlQ29tbWVudDcyNjQwMjU3MQ==
https://api.github.com/repos/huggingface/datasets/issues/comments/726402571/reactions
2020-11-12T23:24:18Z
https://api.github.com/repos/huggingface/datasets/issues/comments/726402571
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
CONTRIBUTOR
This error is because of a mismatch between `datasets` and `bert_score`. With `datasets=1.1.2` and `bert_score>=0.3.6` it works ok. So `pip install -U bert_score` should fix the problem. 
2021-02-09T12:55:48Z
https://github.com/huggingface/datasets/issues/843#issuecomment-775915990
https://api.github.com/repos/huggingface/datasets/issues/843
MDEyOklzc3VlQ29tbWVudDc3NTkxNTk5MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/775915990/reactions
2021-02-09T12:55:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/775915990
https://avatars.githubusercontent.com/u/3596?v=4
https://api.github.com/users/pvl/events{/privacy}
https://api.github.com/users/pvl/followers
https://api.github.com/users/pvl/following{/other_user}
https://api.github.com/users/pvl/gists{/gist_id}
https://github.com/pvl
pvl
MDQ6VXNlcjM1OTY=
https://api.github.com/users/pvl/orgs
https://api.github.com/users/pvl/received_events
https://api.github.com/users/pvl/repos
https://api.github.com/users/pvl/starred{/owner}{/repo}
https://api.github.com/users/pvl/subscriptions
User
https://api.github.com/users/pvl
public
MEMBER
Thanks for the heads up @pvl and for the PR as well :)
2021-02-09T14:21:41Z
https://github.com/huggingface/datasets/issues/843#issuecomment-775975172
https://api.github.com/repos/huggingface/datasets/issues/843
MDEyOklzc3VlQ29tbWVudDc3NTk3NTE3Mg==
https://api.github.com/repos/huggingface/datasets/issues/comments/775975172/reactions
2021-02-09T14:21:41Z
https://api.github.com/repos/huggingface/datasets/issues/comments/775975172
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
NONE
Hello everyone,

I think the  problem is not solved: 

```
from datasets import load_metric
metric=load_metric('bertscore')
metric.compute(
    predictions=predictions,
    references=references,
    lang='fr',
    rescale_with_baseline=True
)
TypeError: get_hash() missing 2 required positional arguments: 'use_custom_baseline' and 'use_fast_tokenizer'
```
This code is produced using `Python 3.6.9 datasets==1.1.2 and bert_score==0.3.10`
2021-08-24T14:54:26Z
https://github.com/huggingface/datasets/issues/843#issuecomment-904714633
https://api.github.com/repos/huggingface/datasets/issues/843
IC_kwDODunzps417NmJ
https://api.github.com/repos/huggingface/datasets/issues/comments/904714633/reactions
2021-08-31T10:06:44Z
https://api.github.com/repos/huggingface/datasets/issues/comments/904714633
https://avatars.githubusercontent.com/u/43438634?v=4
https://api.github.com/users/SkanderHellal/events{/privacy}
https://api.github.com/users/SkanderHellal/followers
https://api.github.com/users/SkanderHellal/following{/other_user}
https://api.github.com/users/SkanderHellal/gists{/gist_id}
https://github.com/SkanderHellal
SkanderHellal
MDQ6VXNlcjQzNDM4NjM0
https://api.github.com/users/SkanderHellal/orgs
https://api.github.com/users/SkanderHellal/received_events
https://api.github.com/users/SkanderHellal/repos
https://api.github.com/users/SkanderHellal/starred{/owner}{/repo}
https://api.github.com/users/SkanderHellal/subscriptions
User
https://api.github.com/users/SkanderHellal
public
MEMBER
Hi ! This has been fixed by https://github.com/huggingface/datasets/pull/2770, we'll do a new release soon to make the fix available :)

In the meantime please use an older version of `bert_score`
2021-08-30T15:17:40Z
https://github.com/huggingface/datasets/issues/843#issuecomment-908431109
https://api.github.com/repos/huggingface/datasets/issues/843
IC_kwDODunzps42JY8F
https://api.github.com/repos/huggingface/datasets/issues/comments/908431109/reactions
2021-08-30T15:17:40Z
https://api.github.com/repos/huggingface/datasets/issues/comments/908431109
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
`metric = load_metric('bertscore')`
`a1 = "random sentences"`
`b1 = "random sentences"`
`metric.compute(predictions = [a1], references = [b1], lang = 'en')`

`Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/stephen_chan/.local/lib/python3.6/site-packages/datasets/metric.py", line 393, in compute
    output = self._compute(predictions=predictions, references=references, **kwargs)
  File "/home/stephen_chan/.cache/huggingface/modules/datasets_modules/metrics/bertscore/361e597a01a41d6cf95d94bbfb01dea16261687abc0c6c74cc9930f80488f363/bertscore.py", line 108, in _compute
    hashcode = bert_score.utils.get_hash(model_type, num_layers, idf, rescale_with_baseline)
TypeError: get_hash() missing 1 required positional argument: 'use_custom_baseline'`

Adding 'use_custom_baseline = False' as an argument produces this error

`Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/stephen_chan/.local/lib/python3.6/site-packages/datasets/metric.py", line 393, in compute
    output = self._compute(predictions=predictions, references=references, **kwargs)
TypeError: _compute() got an unexpected keyword argument 'use_custom_baseline'`

This is on Ubuntu 18.04, Python 3.6.9, datasets version 1.1.2