VLM ODD Online Demo
š
Ask questions about video content
Enpei Zhao
enpeizhao
AI & ML interests
None yet
Recent Activity
updated
a Space
2 days ago
enpeizhao/VLM_ODD_Online_Demo
published
a Space
3 days ago
enpeizhao/VLM_ODD_Online_Demo
replied to
sergiopaniego's
post
3 days ago
Yet Another New Multimodal Fine-Tuning Recipe š„§
š§āš³ In this @HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl.
š” This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer!
We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs).
Check it out! ā”ļø https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo
Organizations
None yet
updated
a
Space
2 days ago
published
a
Space
3 days ago
replied to
sergiopaniego's
post
3 days ago
Great post! Any future plans to release some distillation related recipes?
reacted to
sergiopaniego's
post with š
3 days ago
Post
1080
Yet Another New Multimodal Fine-Tuning Recipe š„§
š§āš³ In this @HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl.
š” This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer!
We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs).
Check it out! ā”ļø https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo
š§āš³ In this @HuggingFace Face Cookbook notebook, we demonstrate how to align a multimodal model (VLM) using Mixed Preference Optimization (MPO) using trl.
š” This recipe is powered by the new MPO support in trl, enabled through a recent upgrade to the DPO trainer!
We align the multimodal model using multiple optimization objectives (losses), guided by a preference dataset (chosen vs. rejected multimodal pairs).
Check it out! ā”ļø https://huggingface.co/learn/cookbook/fine_tuning_vlm_mpo
-
- 1 reply
liked
a
model
4 days ago
updated
a
model
10 days ago
published
a
model
10 days ago
updated
a
model
10 days ago
published
a
model
11 days ago
updated
a
model
11 days ago
published
a
model
11 days ago
updated
a
model
11 days ago
published
a
model
11 days ago
updated
a
model
12 days ago
published
a
model
12 days ago
updated
a
model
12 days ago
published
a
model
12 days ago
updated
a
model
12 days ago
published
a
model
12 days ago
updated
a
model
12 days ago