task_categories:text-generation task_categories:question-answering task_categories:summarization language:ace language:ady language:afr language:aka language:alt language:amh language:ara language:arg language:asm language:ava language:awa language:aym language:aze language:bak language:bam language:ban language:bar language:bel language:ben language:bis language:bod language:bre language:bug language:bul language:cat language:ceb language:ces language:chm language:chr language:chv language:code language:cor language:cos language:crh language:cym language:dan language:deu language:din language:div language:dzo language:ell language:eng language:epo language:est language:eus language:ewe language:fao language:fas language:fij language:fil language:fin language:fon language:fra language:fry language:ful language:fur language:gla language:gle language:glg language:glv language:grn language:guc language:guj language:hat language:hau language:haw language:hbs language:heb language:hif language:hin language:hun language:hye language:ibo language:ido language:iku language:ilo language:isl language:ita language:jam language:jav language:jpn language:kal language:kan language:kas language:kat language:kaz language:kbd language:kbp language:khm language:kik language:kin language:kir language:kom language:kon language:kor language:krc language:kur language:lah language:lao language:lat language:lav language:lij language:lim language:lin language:lit language:lmo language:ltz language:lug language:mai language:mal language:mar language:mdf language:mkd language:mlg language:mlt language:mon language:mri language:msa language:mwl language:mya language:myv language:nav language:nds language:nep language:new language:nia language:nld language:nor language:nso language:nya language:oci language:ori language:orm language:oss language:pag language:pan language:pap language:pol language:por language:pus language:que language:roh language:ron language:run language:rus language:sag language:sah language:san language:scn language:shn language:sin language:slk language:slv language:sme language:smo language:sna language:snd language:som language:sot language:spa language:sqi language:srd language:srn language:ssw language:stq language:sun language:swa language:swe language:szl language:tam language:tat language:tel language:tgk language:tgl language:tha language:tir language:ton language:tsn language:tso language:tuk language:tum language:tur language:tyv language:udm language:uig language:ukr language:urd language:uzb language:vec language:ven language:vie language:war language:wln language:wol language:xal language:xho language:yid language:yor language:zha language:zho language:zul license:apache-2.0 size_categories:1M<n<10M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:2409.12958 region:us