Filter datasets by language code
NONE
The dataset still can be found, if instead of using the search form you just enter the language code in the url, like https://huggingface.co/datasets?language=language:myv. 

But of course having a more complete list of languages in the search form (or just a fallback to the language codes, if they are missing from the code=>language mapping) would be much more convenient!
2023-03-27T10:38:16Z
https://github.com/huggingface/datasets/issues/5675#issuecomment-1484909974
https://api.github.com/repos/huggingface/datasets/issues/5675
IC_kwDODunzps5Yge2W
https://api.github.com/repos/huggingface/datasets/issues/comments/1484909974/reactions
2023-03-27T10:38:16Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1484909974
https://avatars.githubusercontent.com/u/8642136?v=4
https://api.github.com/users/avidale/events{/privacy}
https://api.github.com/users/avidale/followers
https://api.github.com/users/avidale/following{/other_user}
https://api.github.com/users/avidale/gists{/gist_id}
https://github.com/avidale
avidale
MDQ6VXNlcjg2NDIxMzY=
https://api.github.com/users/avidale/orgs
https://api.github.com/users/avidale/received_events
https://api.github.com/users/avidale/repos
https://api.github.com/users/avidale/starred{/owner}{/repo}
https://api.github.com/users/avidale/subscriptions
User
https://api.github.com/users/avidale
public
COLLABORATOR
Hi! I've opened a PR to make these languages searchable on the Hub.
2023-03-27T14:02:43Z
https://github.com/huggingface/datasets/issues/5675#issuecomment-1485162108
https://api.github.com/repos/huggingface/datasets/issues/5675
IC_kwDODunzps5YhcZ8
https://api.github.com/repos/huggingface/datasets/issues/comments/1485162108/reactions
2023-03-27T14:02:43Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1485162108
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
NONE
Thanks @mariosasko!
Do you think it is possible to turn this into a more scalable pipeline? Such as:
1. Looping through all the datasets on the hub and collecting the set of all their language codes;
2. Selecting the codes not covered yet in `Language.ts`
3. Looking up their codes at https://iso639-3.sil.org/code_tables/639/data
4. Adding all the newly found language codes to `Language.ts`
2023-03-28T08:49:47Z
https://github.com/huggingface/datasets/issues/5675#issuecomment-1486462100
https://api.github.com/repos/huggingface/datasets/issues/5675
IC_kwDODunzps5YmZyU
https://api.github.com/repos/huggingface/datasets/issues/comments/1486462100/reactions
2023-03-28T08:49:47Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1486462100
https://avatars.githubusercontent.com/u/8642136?v=4
https://api.github.com/users/avidale/events{/privacy}
https://api.github.com/users/avidale/followers
https://api.github.com/users/avidale/following{/other_user}
https://api.github.com/users/avidale/gists{/gist_id}
https://github.com/avidale
avidale
MDQ6VXNlcjg2NDIxMzY=
https://api.github.com/users/avidale/orgs
https://api.github.com/users/avidale/received_events
https://api.github.com/users/avidale/repos
https://api.github.com/users/avidale/starred{/owner}{/repo}
https://api.github.com/users/avidale/subscriptions
User
https://api.github.com/users/avidale
public
COLLABORATOR
@avidale This has been discussed in https://github.com/huggingface/datasets/issues/4881, so also feel free to share your opinion there.
2023-03-28T12:33:37Z
https://github.com/huggingface/datasets/issues/5675#issuecomment-1486806116
https://api.github.com/repos/huggingface/datasets/issues/5675
IC_kwDODunzps5Yntxk
https://api.github.com/repos/huggingface/datasets/issues/comments/1486806116/reactions
2023-03-28T12:33:37Z
https://api.github.com/repos/huggingface/datasets/issues/comments/1486806116
https://avatars.githubusercontent.com/u/47462742?v=4
https://api.github.com/users/mariosasko/events{/privacy}
https://api.github.com/users/mariosasko/followers
https://api.github.com/users/mariosasko/following{/other_user}
https://api.github.com/users/mariosasko/gists{/gist_id}
https://github.com/mariosasko
mariosasko
MDQ6VXNlcjQ3NDYyNzQy
https://api.github.com/users/mariosasko/orgs
https://api.github.com/users/mariosasko/received_events
https://api.github.com/users/mariosasko/repos
https://api.github.com/users/mariosasko/starred{/owner}{/repo}
https://api.github.com/users/mariosasko/subscriptions
User
https://api.github.com/users/mariosasko
public
Hi! I use the language search field on https://huggingface.co/datasets
However, some of the datasets tagged by ISO language code are not accessible by this search form.
For example, [myv_ru_2022](https://huggingface.co/datasets/slone/myv_ru_2022) is has `myv` language tag but it is not included in Languages search form.
I've also noticed the same problem with `mhr` (see https://huggingface.co/datasets/AigizK/mari-russian-parallel-corpora)