Models

11,603

Full-text search

Active filters: dpo

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 4 days ago • 40 • 13

ToastyPigeon/Qwen3.5-27B-Marvin-DPO-V2

Text Generation • 28B • Updated 4 days ago • 69 • 11

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated about 1 month ago • 156

jpacifico/Chocolatine-2-4B-Instruct-DPO-v2.1

Text Generation • 4B • Updated 1 day ago • 1.92k • 5

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated 2 days ago • 6.07k • 6

nivvis/Qwen3.5-35B-A3B-EQ-v5

Text Generation • 35B • Updated 6 days ago • 1.13k • 5

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.8k • • 266

danielcherubini/Qwen3.5-DeltaCoder-9B

Text Generation • Updated 2 days ago • 251 • 3

WYNN747/burmese-coder-4b-gguf

Text Generation • 7B • Updated 3 days ago • 271 • 2

BramVanroy/GEITje-7B-ultra-GGUF

7B • Updated Dec 6, 2024 • 221 • 10

mlabonne/TwinLlama-3.1-8B-DPO

Text Generation • 8B • Updated Oct 6, 2024 • 27 • 22

ConicCat/Role-mo-V2-7B

Text Generation • 7B • Updated Jan 29 • 12 • 4

mradermacher/Role-mo-V2-7B-i1-GGUF

7B • Updated Jan 31 • 62 • 2

trentmkelly/gpt-4o-distil-Llama-3.1-8B-Instruct

Text Generation • Updated Jan 30 • 7 • 1

HuiyuWang/dpo-qwen-cot-merged

Text Generation • 4B • Updated Mar 1 • 49 • 1

mradermacher/G-Health-14B-instruct-i1-GGUF

15B • Updated 24 days ago • 15.8k • 1

MerlinSafety/HybridIntelligence-0.5B

Text Generation • 0.5B • Updated 20 days ago • 41 • 6

mradermacher/Qwen3.5-35B-A3B-heretic-v2-eq-v1-GGUF

35B • Updated 5 days ago • 2.01k • 1

pathcosmos/EVAFRILL-Mo-3B

Text Generation • Updated 8 days ago • 2.06k • 1

abcsk123/Code-Centric-Align

Updated 9 days ago • 52 • 2

Shubhamw11/gemma-3-270m-dpo-negative

Updated 1 day ago • 44 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 5 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 9 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 6

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 28 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 17 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 7 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 178 • 123