task_categories:translation task_categories:text-generation task_categories:text-classification task_categories:sentence-similarity task_categories:summarization task_categories:fill-mask task_categories:feature-extraction language:en language:fr language:de language:es language:pt language:it language:ja language:ru language:ko language:zh language:hi language:he license:cc-by-4.0 size_categories:1K<n<10K format:json modality:text library:datasets library:pandas library:mlcroissant library:polars region:us multilingual language-modeling text-generation translation machine-translation cross-lingual llm-training transformer-training-data parallel-corpora reasoning-dataset knowledge-base json dolma philosophy culture long-form-content structured-text semantic-similarity educational-material natural-language-understanding jsonl