task_categories:text-generation task_categories:translation language:abk language:abq language:abs language:acm language:adh language:adi language:ady language:aeb language:afr language:agx language:aii language:aim language:ain language:ajz language:akb language:aln language:als language:alt language:amh language:anp language:aoz language:apc language:apt language:arb language:arg language:arq language:ars language:ary language:arz language:asm language:ast language:atb language:ava language:awa language:ayp language:ayr language:azb language:azj language:bak language:bam language:ban language:bar language:bas language:bbc language:bbk language:bcl language:bdq language:bel language:ben language:bew language:bho language:bhp language:bis language:biu language:bjn language:bod language:bos language:brh language:brx language:bts language:btx language:bug language:bul language:bwi language:bxr language:cat language:cbk language:ccp language:ceb language:ces language:cfm language:cha language:che language:chr language:chu language:chv language:cjs language:ckb language:ckt language:cmn language:cnh language:cnw language:cos language:crh language:crj language:crk language:crl language:crs language:csb language:csw language:csy language:ctd language:cym language:czt language:dak language:dan language:dar language:deu language:dik language:diu language:div language:dje language:dks language:dln language:dng language:dnw language:doi language:dru language:dsb language:dtp language:dty language:dzo language:ekk language:ell language:enl language:enm language:epo language:ess language:eus language:eve language:ewo language:ext language:fao language:fas language:ffm language:fij language:fil language:fin language:fit language:fkv language:fmu language:fra language:fro language:frp language:fry language:fuf language:fur language:fuv language:gag language:gaz language:gcf language:gla language:gle language:glg language:glk language:glv language:gmh language:gnb language:goh language:gom language:gos language:grc language:gsw language:gug language:guj language:guz language:hac language:hae language:hak language:hat language:hau language:haw language:hbo language:heb language:her language:hif language:hil language:hin language:hmr language:hne language:hns language:hrv language:hrx language:hsb language:hun language:hwc language:hye language:hyw language:iba language:ibg language:ibo language:ife language:ike language:ikt language:ilo language:ina language:ind language:inh language:isl language:ita language:ivv language:jav language:jpn language:jun language:kaa language:kab language:kac language:kak language:kal language:kam language:kan language:kas language:kat language:kaz language:kbd language:kca language:kdh language:kdr language:kea language:kei language:kgp language:kha language:khk language:khm language:kik language:kin language:kir language:kiu language:kjb language:kjh language:kmr language:knc language:koi language:kor language:kos language:kpv language:krj language:krl language:kru language:ksh language:ksw language:ktj language:ktz language:kua language:kum language:kwn language:kyu language:kzj language:lad language:lao language:lat language:lbe language:ldn language:lew language:lez language:lfn language:lim language:lin language:lis language:lit language:lki language:lld language:lmk language:lnd language:lrc language:ltg language:ltz language:lud language:lug language:luo language:lus language:lvs language:lwg language:lzh language:mag language:mah language:mai language:mak language:mal language:mar language:mas language:mbf language:mdf language:mer language:mfe language:mfg language:mfy language:mhi language:mhr language:mhy language:min language:mip language:mjw language:mkd language:mlt language:mni language:mnk language:mns language:mnw language:moh language:mph language:mqy language:mri language:mrj language:mrw language:mtg language:mui language:mup language:mus language:mvp language:mwf language:mwl language:mww language:mya language:myv language:myx language:mzh language:nah language:nan language:nap language:naq language:nbu language:nde language:ndo language:nds language:new language:nio language:njn language:njo language:nld language:nmf language:nmz language:nno language:nob language:nog language:non language:npi language:npo language:nrf language:nri language:nrm language:nse language:nus language:nya language:nyn language:nzm language:obo language:oci language:ojb language:olo language:orv language:ory language:oss language:ota language:oto language:otw language:pam language:pan language:pap language:pbt language:pcd language:pck language:pcm language:pfl language:plt language:pmq language:pmx language:pnb language:pnt language:pol language:por language:pov language:ppk language:pps language:prg language:pui language:pxm language:quc language:qul language:qup language:qus language:quz language:raw language:rcf language:rel language:rhg language:ria language:rjs language:rmc language:rml language:rmn language:rmy language:rnl language:roh language:ron language:rtm language:rue language:run language:rus language:sah language:san language:sat language:sck language:scn language:sda language:sdc language:sdh language:ses language:sgc language:sgh language:sid language:sin language:sju language:skr language:slk language:slv language:sma language:sme language:smj language:smn language:smo language:sms language:smt language:sna language:snd language:som language:sot language:spa language:srd language:srp language:ssw language:sun language:swe language:swg language:swh language:syc language:syl language:szl language:tab language:tam language:taq language:tat language:tcy language:tcz language:tel language:tet language:tgk language:tha language:thl language:tig language:tir language:tkl language:tkr language:tlh language:tly language:tok language:ton language:tpi language:tpw language:trc language:trp language:trs language:ttj language:tuk language:tur language:tuv language:twx language:tyv language:tzl language:tzm language:udm language:uig language:ukr language:urd language:uzn language:uzs language:vap language:vie language:vot language:vro language:war language:way language:wba language:wbm language:wes language:whk language:wlx language:wol language:wsg language:wwa language:xal language:xho language:xmm language:xmv language:xog language:yaz language:ydd language:yor language:yrk language:yrl language:yua language:yue language:zea language:zgh language:zom language:zsm language:zul license:odc-by size_categories:1B<n<10B format:parquet modality:tabular modality:text library:datasets library:dask library:polars library:mlcroissant region:us