Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
updated
a dataset
about 21 hours ago
nbeerbower/WenyanMix-DPO
published
a dataset
about 21 hours ago
nbeerbower/WenyanMix-DPO
liked
a model
3 days ago
neta-art/Neta-Lumina
Organizations
models
219
nbeerbower/NikuXL-v0.1
Text-to-Image
•
Updated
•
4
nbeerbower/NikuX1-Test
Text-to-Image
•
Updated
•
3
nbeerbower/Yanfei-v2-Qwen3-32B
Text Generation
•
33B
•
Updated
•
7
•
2
nbeerbower/Menghua-Qwen3-32B-lora
Updated
•
1
nbeerbower/Zhiming-Qwen3-32B-lora
Updated
•
1
nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B
12B
•
Updated
•
35
•
4
nbeerbower/Vitus-Qwen3-14B
15B
•
Updated
•
17
•
4
nbeerbower/Vitus-mistral-nemo-12B
12B
•
Updated
•
8
nbeerbower/Yanfei-Qwen3-32B
Text Generation
•
33B
•
Updated
•
3
•
1
nbeerbower/Schreiber-mistral-nemo-12B
Text Generation
•
12B
•
Updated
•
9
•
2
datasets
21
nbeerbower/WenyanMix-DPO
Viewer
•
Updated
•
30.2k
•
5
nbeerbower/NikuX-DPO-captioned
Viewer
•
Updated
•
792
•
64
nbeerbower/NikuX-DPO-filtered
Viewer
•
Updated
•
792
•
54
nbeerbower/NikuX-DPO-concat
Viewer
•
Updated
•
883
•
35
nbeerbower/NikuX3-DPO-Filtered
Viewer
•
Updated
•
581
•
36
nbeerbower/NikuX3-DPO
Viewer
•
Updated
•
651
•
24
nbeerbower/NikuX2-DPO-Filtered
Viewer
•
Updated
•
282
•
27
nbeerbower/YanfeiMix-DPO
Viewer
•
Updated
•
22.4k
•
45
•
1
nbeerbower/human-writing-dpo
Updated
•
76
•
6
nbeerbower/NikuX2-DPO
Viewer
•
Updated
•
333
•
8