task_categories:text-classification annotations_creators:no-annotation language_creators:found multilinguality:multilingual source_datasets:original language:ace language:af language:als language:am language:an language:ang language:ar language:arz language:as language:ast language:av language:ay language:az language:azb language:ba language:bar language:bcl language:be language:bg language:bho language:bjn language:bn language:bo language:bpy language:br language:bs language:bxr language:ca language:cbk language:cdo language:ce language:ceb language:chr language:ckb language:co language:crh language:cs language:csb language:cv language:cy language:da language:de language:diq language:dsb language:dty language:dv language:egl language:el language:en language:eo language:es language:et language:eu language:ext language:fa language:fi language:fo language:fr language:frp language:fur language:fy language:ga language:gag language:gd language:gl language:glk language:gn language:gu language:gv language:ha language:hak language:he language:hi language:hif language:hr language:hsb language:ht language:hu language:hy language:ia language:id language:ie language:ig language:ilo language:io language:is language:it language:ja language:jam language:jbo language:jv language:ka language:kaa language:kab language:kbd language:kk language:km language:kn language:ko language:koi language:kok language:krc language:ksh language:ku language:kv language:kw language:ky language:la language:lad language:lb language:lez language:lg language:li language:lij language:lmo language:ln language:lo language:lrc language:lt language:ltg language:lv language:lzh language:mai language:map language:mdf language:mg language:mhr language:mi language:min language:mk language:ml language:mn language:mr language:mrj language:ms language:mt language:mwl language:my language:myv language:mzn language:nan language:nap language:nb language:nci language:nds language:ne language:new language:nl language:nn language:nrm language:nso language:nv language:oc language:olo language:om language:or language:os language:pa language:pag language:pam language:pap language:pcd language:pdc language:pfl language:pl language:pnb language:ps language:pt language:qu language:rm language:ro language:roa language:ru language:rue language:rup language:rw language:sa language:sah language:sc language:scn language:sco language:sd language:sgs language:sh language:si language:sk language:sl language:sme language:sn language:so language:sq language:sr language:srn language:stq language:su language:sv language:sw language:szl language:ta language:tcy language:te language:tet language:tg language:th language:tk language:tl language:tn language:to language:tr language:tt language:tyv language:udm language:ug language:uk language:ur language:uz language:vec language:vep language:vi language:vls language:vo language:vro language:wa language:war language:wo language:wuu language:xh language:xmf language:yi language:yo language:zea language:zh license:odbl size_categories:100K<n<1M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:1801.07779 region:us language-identification