task_categories:translation language:aar language:abk language:ace language:ach language:afr language:aka language:alz language:amh language:ara language:asm language:ava language:awa language:aym language:aze language:bak language:bal language:bam language:ban language:bbc language:bci language:bel language:bem language:ben language:ber language:bew language:bho language:bik language:bod language:bos language:br language:bts language:btx language:bua language:bul language:cat language:ceb language:ces language:cgg language:cha language:che language:chk language:chm language:chv language:ckb language:cnh language:cos language:crh language:crs language:cym language:dan language:deu language:din language:div language:doi language:dov language:dyu language:dzo language:ell language:eng language:epo language:est language:eus language:ewe language:fao language:fas language:fij language:fil language:fin language:fon language:fra language:fry language:ful language:fur language:gaa language:gla language:gle language:glg language:glv language:gom language:grn language:guj language:hat language:hau language:haw language:heb language:hil language:hin language:hmn language:hrv language:hrx language:hun language:hye language:iba language:ibo language:ilo language:ind language:isl language:ita language:jam language:jav language:jpn language:kac language:kal language:kan language:kat language:kau language:kaz language:kek language:kha language:khm language:kin language:kir language:kom language:kon language:kor language:kri language:ktu language:kur language:lao language:lat language:lav language:lij language:lim language:lin language:lit language:lmo language:ltg language:ltz language:lug language:luo language:lus language:mad language:mah language:mai language:mak language:mal language:mam language:mar language:mfe language:min language:mkd language:mlg language:mlt language:mni language:mon language:mri language:msa language:mwr language:mya language:nbl language:ndc language:nep language:new language:nhe language:nld language:nor language:nso language:nus language:nya language:oci language:ori language:orm language:oss language:pag language:pam language:pan language:pap language:pol language:por language:pus language:que language:rom language:ron language:run language:rus language:sag language:sah language:san language:scn language:shn language:sin language:slk language:slv language:sme language:smo language:sna language:snd language:som language:sot language:spa language:sqi language:srp language:ssw language:sun language:sus language:swa language:swe language:szl language:tah language:tam language:tat language:tcy language:tel language:tet language:tgk language:tha language:tir language:tiv language:ton language:tpi language:trp language:tsn language:tso language:tuk language:tum language:tur language:tyv language:udm language:uig language:ukr language:urd language:uzb language:vec language:ven language:vie language:war language:wol language:xho language:yid language:yor language:yua language:yue language:zap language:zho language:zul size_categories:n<1K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:2409.17892 region:us