task_categories:text-generation language:en license:cc-by-4.0 size_categories:1K<n<10K format:parquet format:optimized-parquet modality:tabular modality:text library:datasets library:pandas library:polars library:mlcroissant arxiv:2602.03429 region:us dpo preference multi-turn synthesis collaborative-writing