task_categories:any-to-any task_categories:text-generation task_categories:image-text-to-text task_categories:text-to-image task_categories:text-to-video task_categories:reinforcement-learning license:cc-by-nc-4.0 size_categories:100K<n<1M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars arxiv:2510.23451 region:us Omni-Modal Alignment Reward multimodal preference-dataset reward-modeling text-to-audio text-to-3d image-text-to-image