Adding Turkic X-WMT evaluation set for machine translation
CONTRIBUTOR
hi! Thank you for all the comments! I believe I addressed them all. Let me know if there is anything else
2022-01-20T19:10:47Z
https://github.com/huggingface/datasets/pull/3605#issuecomment-1017835255
https://api.github.com/repos/huggingface/datasets/issues/3605
IC_kwDODunzps48qu73
https://api.github.com/repos/huggingface/datasets/issues/comments/1017835255/reactions
2022-01-20T19:10:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1017835255
https://avatars.githubusercontent.com/u/26018417?v=4
https://api.github.com/users/mirzakhalov/events{/privacy}
https://api.github.com/users/mirzakhalov/followers
https://api.github.com/users/mirzakhalov/following{/other_user}
https://api.github.com/users/mirzakhalov/gists{/gist_id}
https://github.com/mirzakhalov
mirzakhalov
MDQ6VXNlcjI2MDE4NDE3
https://api.github.com/users/mirzakhalov/orgs
https://api.github.com/users/mirzakhalov/received_events
https://api.github.com/users/mirzakhalov/repos
https://api.github.com/users/mirzakhalov/starred{/owner}{/repo}
https://api.github.com/users/mirzakhalov/subscriptions
User
https://api.github.com/users/mirzakhalov
public
CONTRIBUTOR
Hi there! I was wondering if there is anything else to change before this can be merged
2022-01-25T00:08:48Z
https://github.com/huggingface/datasets/pull/3605#issuecomment-1020676022
https://api.github.com/repos/huggingface/datasets/issues/3605
IC_kwDODunzps481ke2
https://api.github.com/repos/huggingface/datasets/issues/comments/1020676022/reactions
2022-01-25T00:08:48Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1020676022
https://avatars.githubusercontent.com/u/26018417?v=4
https://api.github.com/users/mirzakhalov/events{/privacy}
https://api.github.com/users/mirzakhalov/followers
https://api.github.com/users/mirzakhalov/following{/other_user}
https://api.github.com/users/mirzakhalov/gists{/gist_id}
https://github.com/mirzakhalov
mirzakhalov
MDQ6VXNlcjI2MDE4NDE3
https://api.github.com/users/mirzakhalov/orgs
https://api.github.com/users/mirzakhalov/received_events
https://api.github.com/users/mirzakhalov/repos
https://api.github.com/users/mirzakhalov/starred{/owner}{/repo}
https://api.github.com/users/mirzakhalov/subscriptions
User
https://api.github.com/users/mirzakhalov
public
CONTRIBUTOR
@lhoestq Hi! Just a gentle reminder about the steps to merge this one! 
2022-01-29T01:02:47Z
https://github.com/huggingface/datasets/pull/3605#issuecomment-1024781820
https://api.github.com/repos/huggingface/datasets/issues/3605
IC_kwDODunzps49FO38
https://api.github.com/repos/huggingface/datasets/issues/comments/1024781820/reactions
2022-01-29T01:02:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1024781820
https://avatars.githubusercontent.com/u/26018417?v=4
https://api.github.com/users/mirzakhalov/events{/privacy}
https://api.github.com/users/mirzakhalov/followers
https://api.github.com/users/mirzakhalov/following{/other_user}
https://api.github.com/users/mirzakhalov/gists{/gist_id}
https://github.com/mirzakhalov
mirzakhalov
MDQ6VXNlcjI2MDE4NDE3
https://api.github.com/users/mirzakhalov/orgs
https://api.github.com/users/mirzakhalov/received_events
https://api.github.com/users/mirzakhalov/repos
https://api.github.com/users/mirzakhalov/starred{/owner}{/repo}
https://api.github.com/users/mirzakhalov/subscriptions
User
https://api.github.com/users/mirzakhalov
public
MEMBER
Thanks for the heads up ! I think I fixed the last issue with the YAML tags
2022-01-31T09:38:21Z
https://github.com/huggingface/datasets/pull/3605#issuecomment-1025544532
https://api.github.com/repos/huggingface/datasets/issues/3605
IC_kwDODunzps49IJFU
https://api.github.com/repos/huggingface/datasets/issues/comments/1025544532/reactions
2022-01-31T09:38:21Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1025544532
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
MEMBER
The CI failure is unrelated to this PR and fixed on master, let's merge :)

Thanks a lot !
2022-01-31T09:50:53Z
https://github.com/huggingface/datasets/pull/3605#issuecomment-1025553961
https://api.github.com/repos/huggingface/datasets/issues/3605
IC_kwDODunzps49ILYp
https://api.github.com/repos/huggingface/datasets/issues/comments/1025553961/reactions
2022-01-31T09:50:53Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1025553961
https://avatars.githubusercontent.com/u/42851186?v=4
https://api.github.com/users/lhoestq/events{/privacy}
https://api.github.com/users/lhoestq/followers
https://api.github.com/users/lhoestq/following{/other_user}
https://api.github.com/users/lhoestq/gists{/gist_id}
https://github.com/lhoestq
lhoestq
MDQ6VXNlcjQyODUxMTg2
https://api.github.com/users/lhoestq/orgs
https://api.github.com/users/lhoestq/received_events
https://api.github.com/users/lhoestq/repos
https://api.github.com/users/lhoestq/starred{/owner}{/repo}
https://api.github.com/users/lhoestq/subscriptions
User
https://api.github.com/users/lhoestq
public
This dataset is a human-translated evaluation set for MT crowdsourced and provided by the [Turkic Interlingua ](turkic-interlingua.org) community. It contains eval sets for 8 Turkic languages covering 88 language directions. Languages being covered are:

Azerbaijani (az)
Bashkir (ba)
English (en)
Karakalpak (kaa)
Kazakh (kk)
Kirghiz (ky)
Russian (ru)
Turkish (tr)
Sakha (sah)
Uzbek (uz)

More info about the corpus is here: [https://github.com/turkic-interlingua/til-mt/tree/master/xwmt](https://github.com/turkic-interlingua/til-mt/tree/master/xwmt)

A paper describing the test set is here: [https://arxiv.org/abs/2109.04593](https://arxiv.org/abs/2109.04593)
