task_categories:text-generation task_categories:image-text-to-text task_categories:video-text-to-text task_categories:audio-text-to-text task_categories:text-to-image task_categories:text-to-video task_categories:text-to-audio task_categories:text-to-3d task_categories:image-to-image license:cc-by-nc-4.0 size_categories:1K<n<10K format:parquet modality:audio modality:image modality:text modality:video library:datasets library:pandas library:mlcroissant library:polars arxiv:2510.23451 region:us reward-modeling preference-alignment multimodal