A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Thien Tran
gaunernst
AI & ML interests
None yet
Recent Activity
new activity
3 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Broken results with vLLM
new activity
8 days ago
gaunernst/gemma-3-27b-it-qat-autoawq:Cannot find the config file for awq
new activity
8 days ago
gaunernst/gemma-3-27b-it-int4-awq:Model running badly on vLLM
Organizations
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 20 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 1.14k • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.52k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 1.9k • 10
A collection of MoE+MLA models, serving as testing proxies for DeepSeek-V3/R1
Convert official Gemma 3 QAT GGUF to AutoAWQ and compressed-tensors format for ease of deployment
-
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation • 0.4B • Updated • 20 -
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text • 2B • Updated • 1.14k • 1 -
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text • 3B • Updated • 1.52k • 6 -
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text • 6B • Updated • 1.9k • 10
models
55
gaunernst/vit_base_patch16_1024_128.audiomae_as2m
0.1B
•
Updated
•
217
•
1
gaunernst/gemma-3-27b-it-qat-autoawq
Image-Text-to-Text
•
6B
•
Updated
•
1.9k
•
10
gaunernst/gemma-3-27b-it-qat-compressed-tensors
Image-Text-to-Text
•
6B
•
Updated
•
1.76k
•
9
gaunernst/gemma-3-12b-it-qat-compressed-tensors
Image-Text-to-Text
•
3B
•
Updated
•
1.2k
•
1
gaunernst/gemma-3-4b-it-qat-compressed-tensors
Image-Text-to-Text
•
2B
•
Updated
•
1.4k
•
1
gaunernst/gemma-3-1b-it-qat-compressed-tensors
Text Generation
•
0.4B
•
Updated
•
576
gaunernst/DeepSeek-V2-Lite-Chat-FP8
16B
•
Updated
•
940
gaunernst/gemma-3-12b-it-qat-autoawq
Image-Text-to-Text
•
3B
•
Updated
•
1.52k
•
6
gaunernst/gemma-3-4b-it-qat-autoawq
Image-Text-to-Text
•
2B
•
Updated
•
1.14k
•
1
gaunernst/gemma-3-1b-it-qat-autoawq
Text Generation
•
0.4B
•
Updated
•
20
datasets
11
gaunernst/ms1mv3-recordio
Updated
•
26
•
1
gaunernst/flux-dev-portrait
Viewer
•
Updated
•
2k
•
173
•
1
gaunernst/pexels-portrait
Viewer
•
Updated
•
9.85k
•
21
•
1
gaunernst/ffhq-1024-wds
Viewer
•
Updated
•
70.3k
•
206
gaunernst/face-recognition-eval
Updated
•
9
gaunernst/voxceleb2-dev-wds
Viewer
•
Updated
•
1.09M
•
66
gaunernst/glint360k-wds-gz
Viewer
•
Updated
•
17.1M
•
652
•
2
gaunernst/webface4m-wds-gz
Viewer
•
Updated
•
4.24M
•
110
•
1
gaunernst/ms1mv3-wds-gz
Viewer
•
Updated
•
5.18M
•
4
•
1
gaunernst/tokenized-datasets
Updated
•
8