Unsloth Dynamic 2.0 Quants

unsloth 's Collections

Qwen3

DeepSeek R1 (All Versions)

Gemma 3n

Llama 4

Phi-4 (All Versions)

Qwen3-Coder

Gemma 3

Unsloth 4-bit Dynamic Quants

Deepseek V3 (All Versions)

Text-to-Speech (TTS) models

Diffusion + FLUX models

Mistral Small 3 (All Versions)

Llama 3.2

Llama 3.3 (All Versions)

Qwen2.5-VL (All Versions)

Qwen QwQ-32B Collection

Vision/multimodal Models

Llama 3.2 Vision

Qwen 2.5 Coder

Llama 3.1 Collection

Qwen 2.5

Load 4bit models 4x faster

4bit Instruct Models

updated 1 day ago

New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance.

Upvote

154

unsloth/Qwen3-235B-A22B-Thinking-2507-GGUF

235B • Updated 2 days ago • 37.2k • 48

Note New Qwen3 models:
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF

Text Generation • 480B • Updated 4 days ago • 49.2k • 115
unsloth/Qwen3-235B-A22B-Instruct-2507-GGUF

Text Generation • 235B • Updated 3 days ago • 64.8k • 82
unsloth/Kimi-K2-Instruct-GGUF

Text Generation • 1T • Updated 5 days ago • 149k • 163

Note Kimi K2:
unsloth/gemma-3n-E4B-it-GGUF

Image-Text-to-Text • 7B • Updated 27 days ago • 216k • 140

Note Google's new Gemma 3n:
unsloth/gemma-3n-E2B-it-GGUF

Image-Text-to-Text • 4B • Updated 10 days ago • 116k • 33
unsloth/Magistral-Small-2506-GGUF

24B • Updated 3 days ago • 59.9k • 87

Note New Mistral models:
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF

Image-Text-to-Text • 24B • Updated Jun 23 • 71.7k • 80
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 16 • 941k • 263

Note DeepSeek-R1-0528:
unsloth/DeepSeek-R1-0528-GGUF

Text Generation • 671B • Updated Jun 15 • 122k • 182
unsloth/Devstral-Small-2505-GGUF

Text Generation • 24B • Updated May 25 • 24.7k • 101

Note Mistral-Devstral:
unsloth/Phi-4-reasoning-plus-GGUF

Text Generation • 15B • Updated May 1 • 12.8k • 61

Note Phi-4 (reasoning):
unsloth/Phi-4-mini-reasoning-GGUF

Text Generation • 4B • Updated May 1 • 8.64k • 39
unsloth/Phi-4-reasoning-GGUF

Text Generation • 15B • Updated May 1 • 2.97k • 10
unsloth/Qwen3-32B-GGUF

Text Generation • 33B • Updated Jun 8 • 29.1k • 78

Note Qwen3:
unsloth/Qwen3-14B-GGUF

Text Generation • 15B • Updated Jun 8 • 28k • 61
unsloth/Qwen3-8B-GGUF

Text Generation • 8B • Updated Jun 8 • 19.6k • 59
unsloth/Qwen3-30B-A3B-GGUF

Text Generation • 31B • Updated Jun 8 • 127k • 235
unsloth/Qwen3-235B-A22B-GGUF

Text Generation • 235B • Updated Jun 8 • 37k • 65
unsloth/Qwen3-4B-GGUF

Text Generation • 4B • Updated Jun 8 • 29.2k • 60
unsloth/Qwen3-0.6B-GGUF

Text Generation • 0.6B • Updated Jun 23 • 28.6k • 66
unsloth/DeepSeek-R1-GGUF-UD

Text Generation • 671B • Updated Apr 28 • 1.52k • 16

Note DeepSeek:
unsloth/DeepSeek-V3-0324-GGUF-UD

Text Generation • 671B • Updated Apr 28 • 6.38k • 15
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text • 108B • Updated Jun 17 • 87.5k • 108

Note Llama 4:
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF

Image-Text-to-Text • 401B • Updated Jun 18 • 23.5k • 33
unsloth/gemma-3-27b-it-GGUF

Image-Text-to-Text • 27B • Updated May 12 • 28k • 143

Note Gemma 3:
unsloth/gemma-3-12b-it-GGUF

Image-Text-to-Text • 12B • Updated May 12 • 53.3k • 92
unsloth/gemma-3-4b-it-GGUF

Image-Text-to-Text • 4B • Updated May 12 • 29.7k • 116
unsloth/gemma-3-1b-it-GGUF

Text Generation • 1.0B • Updated May 9 • 28.4k • 47
unsloth/GLM-4-32B-0414-GGUF

Text Generation • 33B • Updated 24 days ago • 14.7k • 38

Note GLM-4:
unsloth/QwQ-32B-GGUF

Text Generation • 33B • Updated Apr 27 • 4.82k • 86

Note Qwen QwQ:
unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

24B • Updated May 21 • 6.25k • 80

Note Mistral:
unsloth/MAI-DS-R1-GGUF

Text Generation • 671B • Updated Apr 27 • 1.2k • 6

Note Microsoft MAI-DS-R1:
unsloth/Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated May 9 • 5.09k • 12

Note Llama 3.1:
unsloth/gemma-3-27b-it-qat-GGUF

Image-Text-to-Text • 27B • Updated May 9 • 11k • 12

Note Gemma 3 (QAT):
unsloth/gemma-3-12b-it-qat-GGUF

Image-Text-to-Text • 12B • Updated May 12 • 10.1k • 24
unsloth/gemma-3-4b-it-qat-GGUF

Image-Text-to-Text • 4B • Updated Jun 15 • 13.2k • 15
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • 8B • Updated May 10 • 53.8k • 275

Note DeepSeek-R1-Distill:
unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • 2B • Updated Apr 19 • 21.5k • 115

Upvote

154

Collection guide
Browse collections