Fix bug with labels of eurlex config of lex_glue dataset
NONE
_The documentation is not available anymore as the PR was closed or merged._
2022-09-30T09:53:44Z
https://github.com/huggingface/datasets/pull/5048#issuecomment-1263360109
https://api.github.com/repos/huggingface/datasets/issues/5048
IC_kwDODunzps5LTVht
https://api.github.com/repos/huggingface/datasets/issues/comments/1263360109/reactions
2022-09-30T16:23:43Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1263360109
https://avatars.githubusercontent.com/u/99929124?v=4
https://api.github.com/users/HuggingFaceDocBuilderDev/events{/privacy}
https://api.github.com/users/HuggingFaceDocBuilderDev/followers
https://api.github.com/users/HuggingFaceDocBuilderDev/following{/other_user}
https://api.github.com/users/HuggingFaceDocBuilderDev/gists{/gist_id}
https://github.com/HuggingFaceDocBuilderDev
HuggingFaceDocBuilderDev
U_kgDOBfTMJA
https://api.github.com/users/HuggingFaceDocBuilderDev/orgs
https://api.github.com/users/HuggingFaceDocBuilderDev/received_events
https://api.github.com/users/HuggingFaceDocBuilderDev/repos
https://api.github.com/users/HuggingFaceDocBuilderDev/starred{/owner}{/repo}
https://api.github.com/users/HuggingFaceDocBuilderDev/subscriptions
User
https://api.github.com/users/HuggingFaceDocBuilderDev
public
CONTRIBUTOR
@JamesLYC88 here is the fix! Thanks again!
2022-09-30T10:42:12Z
https://github.com/huggingface/datasets/pull/5048#issuecomment-1263412361
https://api.github.com/repos/huggingface/datasets/issues/5048
IC_kwDODunzps5LTiSJ
https://api.github.com/repos/huggingface/datasets/issues/comments/1263412361/reactions
2022-09-30T10:42:12Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1263412361
https://avatars.githubusercontent.com/u/1626984?v=4
https://api.github.com/users/iliaschalkidis/events{/privacy}
https://api.github.com/users/iliaschalkidis/followers
https://api.github.com/users/iliaschalkidis/following{/other_user}
https://api.github.com/users/iliaschalkidis/gists{/gist_id}
https://github.com/iliaschalkidis
iliaschalkidis
MDQ6VXNlcjE2MjY5ODQ=
https://api.github.com/users/iliaschalkidis/orgs
https://api.github.com/users/iliaschalkidis/received_events
https://api.github.com/users/iliaschalkidis/repos
https://api.github.com/users/iliaschalkidis/starred{/owner}{/repo}
https://api.github.com/users/iliaschalkidis/subscriptions
User
https://api.github.com/users/iliaschalkidis
public
CONTRIBUTOR
Thanks, @albertvillanova. When do you expect that this change will take effect when someone downloads the dataset?
2022-09-30T16:23:21Z
https://github.com/huggingface/datasets/pull/5048#issuecomment-1263774753
https://api.github.com/repos/huggingface/datasets/issues/5048
IC_kwDODunzps5LU6wh
https://api.github.com/repos/huggingface/datasets/issues/comments/1263774753/reactions
2022-09-30T16:23:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1263774753
https://avatars.githubusercontent.com/u/1626984?v=4
https://api.github.com/users/iliaschalkidis/events{/privacy}
https://api.github.com/users/iliaschalkidis/followers
https://api.github.com/users/iliaschalkidis/following{/other_user}
https://api.github.com/users/iliaschalkidis/gists{/gist_id}
https://github.com/iliaschalkidis
iliaschalkidis
MDQ6VXNlcjE2MjY5ODQ=
https://api.github.com/users/iliaschalkidis/orgs
https://api.github.com/users/iliaschalkidis/received_events
https://api.github.com/users/iliaschalkidis/repos
https://api.github.com/users/iliaschalkidis/starred{/owner}{/repo}
https://api.github.com/users/iliaschalkidis/subscriptions
User
https://api.github.com/users/iliaschalkidis
public
MEMBER
The change is immediately available now, since this change we made to our library:
- #4059
2022-09-30T16:28:24Z
https://github.com/huggingface/datasets/pull/5048#issuecomment-1263779509
https://api.github.com/repos/huggingface/datasets/issues/5048
IC_kwDODunzps5LU761
https://api.github.com/repos/huggingface/datasets/issues/comments/1263779509/reactions
2022-09-30T16:30:25Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1263779509
https://avatars.githubusercontent.com/u/8515462?v=4
https://api.github.com/users/albertvillanova/events{/privacy}
https://api.github.com/users/albertvillanova/followers
https://api.github.com/users/albertvillanova/following{/other_user}
https://api.github.com/users/albertvillanova/gists{/gist_id}
https://github.com/albertvillanova
albertvillanova
MDQ6VXNlcjg1MTU0NjI=
https://api.github.com/users/albertvillanova/orgs
https://api.github.com/users/albertvillanova/received_events
https://api.github.com/users/albertvillanova/repos
https://api.github.com/users/albertvillanova/starred{/owner}{/repo}
https://api.github.com/users/albertvillanova/subscriptions
User
https://api.github.com/users/albertvillanova
public
Fix for a critical bug in the EURLEX dataset label list to make LexGLUE EURLEX results replicable. 

In LexGLUE (Chalkidis et al., 2022), the following is mentioned w.r.t. EUR-LEX: _"It supports four different label granularities, comprising 21, 127, 567, 7390 EuroVoc concepts, respectively. We use the 100 most frequent concepts from level 2 [...]”._ The current label list has all 127 labels, which leads to different (lower) results, as communicated by users.

Thanks!