Sleeping
VLM ODD Online Demo
🏃
Ask questions about video content
Enpei Zhao
enpeizhao
AI & ML interests
None yet
Recent Activity
updated
a Space
2 days ago
enpeizhao/VLM_ODD_Online_Demo
published
a Space
3 days ago
enpeizhao/VLM_ODD_Online_Demo
replied to
sergiopaniego's
post
3 days ago
Yet Another New Multimodal Fine-Tuning Recipe 🥧
🧑🍳 In this @HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl.
💡 This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer!
We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs).
Check it out! ➡️ https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo
Organizations
None yet
models
26
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-13_adapter
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-13
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-vlm-odd-12-nf4-merged
Image-to-Text
•
2B
•
Updated
•
17
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-12-merged
Image-to-Text
•
4B
•
Updated
•
2
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-12_adapter
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-12
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-11_adapter
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-11
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-9_adapter
Updated
enpeizhao/qwen2_5-3b-instruct-trl-sft-all-in-one-9
Updated
datasets
0
None public yet