task_categories:translation language:aar language:abe language:abk language:abq language:abt language:abz language:act language:acu language:acw language:ady language:afr language:agq language:agr language:agx language:ahg language:ahk language:aht language:ain language:ajz language:aka language:ake language:akj language:akk language:akl language:akv language:akz language:ale language:alh language:alq language:als language:alt language:amh language:ami language:ang language:ani language:anv language:aoi language:apy language:aqc language:aqt language:arb language:arc language:arg language:arl language:arn language:aro language:arp language:art language:ary language:arz language:asa language:asm language:ast language:ata language:auc language:aus language:ava language:ave language:awc language:aym language:ayo language:ayr language:azb language:azj language:azo language:azz language:bag language:bak language:bal language:bam language:ban language:bar language:bas language:bbc language:bbj language:bbq language:bbw language:bcc language:bch language:bcj language:bck language:bcl language:bdd language:bdk language:bdy language:bef language:bej language:bel language:bem language:ben language:bez language:bfj language:bfw language:bgj language:bgn language:bhg language:bis language:biw language:biy language:bjb language:bje language:bjg language:bji language:bjv language:bjw language:bkh language:bkm language:bkw language:bla language:bmu language:bmv language:bni language:bnt language:boa language:bod language:bon language:bos language:bot language:bou language:bph language:bpy language:bqt language:bre language:bri language:brx language:bsk language:bug language:bul language:buw language:bva language:bvr language:bxj language:bxk language:bxn language:bxr language:byn language:bzp language:bzt language:cab language:caf language:cag language:cao language:cap language:car language:cas language:cat language:cau language:cav language:cbi language:cbr language:cbs language:ccc language:cdc language:cdo language:ceb language:ces language:cgg language:cha language:chb language:chc language:che language:chk language:chm language:chn language:cho language:chr language:chu language:chv language:chy language:ciw language:cji language:cjs language:ckb language:cku language:cla language:clm language:cmn language:cng language:cnx language:cof language:con language:cop language:cor language:cos language:crh language:crj language:crs language:crt language:crx language:csb language:ctz language:cub language:cuh language:cwe language:cwg language:cyb language:cym language:dan language:dar language:dav language:dbq language:dbu language:dbw language:dcr language:ddj language:ddo language:deu language:dgr language:dgz language:dhg language:dhl language:dhr language:dib language:diq language:div language:djd language:dje language:djk language:djm language:dlm language:dma language:dmb language:dmn language:dnj language:dob language:doe language:drl language:dsb language:dtk language:dts language:dtt language:dua language:dws language:dyb language:dym language:dze language:dzo language:ebu language:egy language:ekg language:ekk language:ell language:emy language:eng language:enm language:enx language:epo language:erk language:ese language:esi language:eus language:evn language:ewe language:fao language:fij language:fil language:fin language:fip language:fiu language:fkv language:fli language:fmp language:fra language:frc language:frk language:fro language:frp language:fry language:fub language:fuc language:fuf language:fuh language:fur language:gaa language:gag language:gan language:gaz language:gbd language:gbj language:gby language:gcf language:gdo language:gdr language:ggw language:ghl language:gil language:gin language:gjn language:gla language:gld language:gle language:glg language:glv language:gmh language:gnd language:goh language:gom language:got language:gqa language:gqr language:grc language:gsw language:guc language:gue language:gug language:gui language:guj language:guk language:gup language:guq language:guz language:gvc language:gvf language:gvl language:gwd language:gwe language:gwi language:gwr language:gww language:gyd language:gym language:hak language:han language:haq language:hat language:hau language:haw language:hay language:hbo language:hbs language:hdn language:hdy language:heb language:heh language:hig language:hil language:hin language:hit language:hla language:hnj language:hnn language:hoc language:hrv language:hsb language:hsn language:hub language:hun language:hup language:huu language:huz language:hvn language:hye language:hyw language:iba language:ibb language:ibo language:ido language:ifk language:ign language:igs language:ihp language:iii language:iku language:ikx language:ikz language:ile language:ilo language:ina language:ind language:ing language:inh language:irk language:isk language:isl language:ita language:ium language:ivb language:ivv language:jaa language:jam language:jav language:jbo language:jit language:jiv language:jmc language:jpn language:jup language:kaa language:kab language:kal language:kam language:kan language:kap language:kas language:kat language:kav language:kaw language:kaz language:kbd language:kca language:kck language:kcu language:kdc language:kde language:kdi language:kdr language:kea language:ked language:kek language:ker language:ket language:kew language:kfc language:kff language:kfm language:kgo language:kgp language:kha language:khk language:khm language:khv language:kig language:kik language:kin language:kir language:kit language:kiu language:kiv language:kiz language:kjc language:kjd language:kjh language:kjj language:klb language:kld language:kln language:kmg language:kmr language:kmw language:knc language:kne language:knn language:koh language:koi language:koo language:kor language:kpt language:kpv language:kpx language:kqc language:kqi language:krc language:krl language:ksb language:ksh language:ksp language:ksr language:ktb language:ktg language:ktw language:ktz language:kuj language:kum language:kun language:kuu language:kuz language:kva language:kwv language:kxj language:kxv language:kya language:kye language:kyh language:lac language:lad language:lag language:lai language:lao language:lap language:lat language:lbe language:lbk language:ldi language:ldn language:lea language:leh language:lev language:lez language:lfn language:lij language:lim language:lin language:lit language:liv language:lkt language:lld language:lme language:lmn language:lmo language:lmp language:loz language:lsm language:ltc language:ltg language:ltz language:lua language:lug language:lui language:luo language:luq language:lus language:luy language:lvs language:lzh language:mah language:mak language:mal language:mam language:map language:mar language:mas language:maz language:mbb language:mbc language:mbq language:mca language:mcd language:mcx language:mde language:mdf language:mec language:mem language:men language:mer language:meu language:mfe language:mfm language:mge language:mgq language:mgr language:mgs language:mgu language:mgv language:mhr language:mic language:mim language:miq language:mjg language:mkd language:mkn language:mla language:mlg language:mlt language:mmy language:mnc language:mnh language:mns language:moc language:mog language:mov language:moz language:mpa language:mph language:mpj language:mpm language:mqy language:mri language:mrq language:mrw language:mrz language:msm language:msn language:mtp language:mua language:mvb language:mvi language:mwe language:mwm language:mwn language:mww language:mxb language:mxx language:mya language:myb language:mye language:myk language:myv language:myw language:myx language:mzh language:mzj language:mzn language:mzp language:nap language:naq language:nau language:nav language:nci language:ncu language:nde language:ndg language:ndh language:ndj language:nds language:new language:nfa language:nfu language:ngf language:ngj language:ngk language:ngo language:ngp language:ngq language:nic language:nid language:nih language:nij language:nim language:nit language:njy language:nld language:nly language:nmc language:nmm language:nmn language:nna language:nnb language:nno language:nnq language:nob language:nog language:non language:nov language:now language:npi language:npl language:nrl language:nrn language:nsk language:ntk language:nuj language:nuy language:nya language:nyb language:nyh language:nym language:nyn language:nyo language:nys language:nyv language:nyy language:nzz language:oar language:oci language:oco language:odu language:ogc language:omq language:one language:opm language:orh language:oro language:ort language:ory language:oss language:ota language:ote language:otk language:oym language:ozm language:paa language:pag language:pak language:pam language:pan language:pap language:pau language:pbb language:pbh language:pbr language:pbt language:pbu language:pcd language:pdt language:pem language:pes language:pgd language:pib language:pit language:piw language:plg language:pli language:plj language:plt language:pmf language:pml language:pms language:pmt language:pnw language:pny language:poi language:pol language:por language:pot language:poy language:poz language:pqe language:pqm language:pqw language:prg language:prs language:pui language:pum language:pwn language:qub language:quc language:que language:quf language:quh language:qul language:qus language:quy language:quz language:qvc language:qve language:qvi language:qvs language:qvw language:qxn language:qxs language:qxw language:rag language:rap language:reg language:rhg language:rif language:rim language:rjs language:rmc language:rmq language:rmv language:rmy language:rnw language:rob language:rof language:roh language:rom language:ron language:rop language:rou language:rtm language:rub language:ruf language:rui language:run language:rup language:rus language:rut language:rwk language:rwr language:ryn language:ryu language:sac language:sag language:sah language:san language:sas language:sat language:sba language:sbf language:sbk language:sbp language:scn language:sco language:see language:sef language:sei language:sel language:ses language:sga language:sgs language:shb language:shg language:shh language:shi language:shp language:shr language:sid language:sim language:sin language:sja language:sjd language:sje language:sjn language:skt language:slk language:slv language:sma language:sme language:smj language:smk language:smn language:smo language:sms language:sna language:snc language:snd language:snk language:snn language:som language:sot language:soz language:spa language:spn language:sqi language:srb language:src language:srd language:srm language:srn language:srp language:srq language:ssp language:stq language:str language:sue language:suj language:suk language:sun language:suw language:sux language:swb language:swe language:swg language:swh language:swt language:sxb language:sxn language:syc language:szl language:tab language:tah language:tai language:tam language:tao language:taq language:tar language:tat language:tay language:tbc language:tde language:tdt language:teg language:tek language:tel language:tet language:tfn language:tgk language:tgl language:tha language:thf language:thk language:thq language:tin language:tir language:tkr language:tlh language:tli language:tlj language:tmf language:tna language:ton language:top language:tpi language:tqo language:trv language:tsd language:tsi language:tsn language:tsz language:ttj language:ttt language:ttv language:tue language:tuk language:tur language:tvl language:tvu language:twq language:txb language:txg language:tyv language:tzl language:tzm language:tzo language:udi language:udm language:uig language:ukr language:ulw language:und language:unr language:urd language:ute language:uzn language:vai language:val language:vec language:ven language:vep language:vie language:vif language:vin language:viv language:vls language:vma language:vmw language:vol language:vot language:vro language:vun language:wae language:wap language:waq language:war language:wau language:waw language:wbh language:wbi language:wbp language:wbt language:wbv language:wca language:wdd language:wic language:wim language:wiv language:wkw language:wlk language:wln language:wmt language:wno language:wny language:wol language:won language:wrh language:wrz language:wsg language:wun language:wuu language:wyb language:xal language:xan language:xbr language:xcl language:xho language:xkv language:xno language:xog language:xpq language:xsl language:xsr language:xsv language:xtc language:xte language:xto language:xug language:xww language:yaa language:yad language:yae language:yai language:yak language:yan language:yao language:yaq language:yau language:ybb language:ybh language:ydd language:yij language:yle language:yml language:ynd language:yns language:yor language:yrk language:yua language:yue language:yur language:zad language:zag language:zaj language:zak language:zap language:zav language:zdj language:zga language:zho language:zin language:ziw language:zku language:zlm language:zne language:zoh language:zpq language:zsm language:ztu language:zul language:zun language:zyb language:zyg license:cc0-1.0 size_categories:100M<n<1B format:csv modality:tabular modality:text library:datasets library:dask library:mlcroissant library:polars region:us