task_categories:other annotations_creators:expert-generated annotations_creators:crowdsourced multilinguality:multilingual language:af language:ar language:az language:be language:bg language:bn language:br language:bs language:ca language:ch language:cs language:cv language:cy language:da language:de language:el language:en language:eo language:es language:et language:eu language:fa language:fi language:fo language:fr language:fy language:ga language:gd language:gl language:gn language:he language:hi language:hr language:hu language:hy language:ia language:id language:ie language:io language:is language:it language:ja language:jv language:ka language:kk language:km language:ko language:ku language:kw language:la language:lb language:lt language:lv language:mi language:mk language:ml language:mn language:mr language:ms language:mt language:my language:nb language:nl language:nn language:no language:oc language:pl language:pt language:qu language:rn language:ro language:ru language:sh language:sl language:sq language:sr language:sv language:sw language:ta language:te language:th language:tk language:tl language:tr language:tt language:ug language:uk language:ur language:uz language:vi language:vo language:yi language:zh language:ace language:acm language:acq language:aeb language:ajp language:ak language:als language:am language:apc language:ars language:ary language:arz language:as language:ast language:awa language:ayr language:azb language:azj language:ba language:bm language:ban language:bem language:bho language:bjn language:bo language:bug language:ceb language:cjk language:ckb language:crh language:dik language:dyu language:dz language:ee language:fj language:fon language:fur language:fuv language:gaz language:gu language:ht language:ha language:hne language:ig language:ilo language:kab language:kac language:kam language:kn language:ks language:kbp language:kea language:khk language:ki language:rw language:ky language:kmb language:kmr language:knc language:kg language:lo language:lij language:li language:ln language:lmo language:ltg language:lua language:lg language:luo language:lus language:lvs language:mag language:mai language:mar language:min language:mni language:mos language:npi language:nso language:nus language:ny language:ory language:pag language:pa language:pap language:pbt language:pes language:plt language:prs language:quy language:sg language:sa language:sat language:scn language:shn language:si language:sk language:sm language:sn language:sd language:so language:st language:sc language:ss language:su language:swh language:szl language:taq language:tg language:ti language:tpi language:tn language:ts language:tum language:tw language:tzm language:umb language:uzn language:vec language:war language:wo language:xh language:ydd language:yo language:yue language:zsm language:zu license:apache-2.0 size_categories:100M<n<1B format:parquet modality:text library:datasets library:dask library:mlcroissant library:polars arxiv:2211.01786 region:us