task_categories:token-classification language:afr language:ara language:arg language:ast language:azb language:aze language:bak language:bar language:bel language:bos language:bpy language:bre language:bul language:bxg language:cat language:ceb language:ces language:che language:chv language:cym language:dan language:deu language:eng language:est language:eus language:fas language:fin language:fra language:fry language:gle language:glg language:guj language:hbs language:heb language:hin language:hrv language:ht language:hun language:hye language:ido language:ind language:isl language:ita language:jav language:jpn language:kan language:kat language:kaz language:kor language:ky language:lat language:lav language:lit language:lmo language:ltz language:lzh language:mal language:mar language:mbp language:min language:mkd language:mlg language:mon language:mus language:mya language:nds language:ne language:new language:nld language:nno language:nor language:oci language:pan language:pms language:pnb language:pol language:por language:ron language:rus language:scn language:sco language:slk language:slv language:spa language:sqi language:srp language:sun language:swe language:swh language:tam language:tat language:tel language:tgk language:tgl language:tha language:tur language:ukr language:urd language:uzb language:vie language:vol language:wbf language:yor language:zho license:cc-by-2.0 size_categories:10M<n<100M format:parquet format:optimized-parquet library:datasets library:dask library:polars library:mlcroissant region:us rag RAG chunking