Fix bleurt logging import
MEMBER
That’s a good point that we started to discuss internally as well. We should pin the dataset en metrics code by default indeed.
Let’s update this in the coming release.
2020-09-01T06:12:54Z
https://github.com/huggingface/datasets/pull/549#issuecomment-684416457
https://api.github.com/repos/huggingface/datasets/issues/549
MDEyOklzc3VlQ29tbWVudDY4NDQxNjQ1Nw==
https://api.github.com/repos/huggingface/datasets/issues/comments/684416457/reactions
2020-09-01T06:12:54Z
https://api.github.com/repos/huggingface/datasets/issues/comments/684416457
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
MEMBER
Ok closed this with #567 and we are working on a more general solution to pin dataset version in #562 (should be in the coming release).
2020-09-03T09:04:20Z
https://github.com/huggingface/datasets/pull/549#issuecomment-686357080
https://api.github.com/repos/huggingface/datasets/issues/549
MDEyOklzc3VlQ29tbWVudDY4NjM1NzA4MA==
https://api.github.com/repos/huggingface/datasets/issues/comments/686357080/reactions
2020-09-03T09:04:20Z
https://api.github.com/repos/huggingface/datasets/issues/comments/686357080
https://avatars.githubusercontent.com/u/7353373?v=4
https://api.github.com/users/thomwolf/events{/privacy}
https://api.github.com/users/thomwolf/followers
https://api.github.com/users/thomwolf/following{/other_user}
https://api.github.com/users/thomwolf/gists{/gist_id}
https://github.com/thomwolf
thomwolf
MDQ6VXNlcjczNTMzNzM=
https://api.github.com/users/thomwolf/orgs
https://api.github.com/users/thomwolf/received_events
https://api.github.com/users/thomwolf/repos
https://api.github.com/users/thomwolf/starred{/owner}{/repo}
https://api.github.com/users/thomwolf/subscriptions
User
https://api.github.com/users/thomwolf
public
Bleurt started throwing an error in some code we have.
This looks like the fix but...

It's also unnerving that even a prebuilt docker image with pinned versions can be working 1 day and then fail the next (especially for production systems).

Any way for us to pin your metrics code so that they are guaranteed not to to change and possibly fail on repository changes?

Thanks (and also for your continued work on the lib...)