Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,770

Full-text search

Active filters: 4-bit

mlx-community/Qwen2.5-Coder-14B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 1.93k • 7

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • 71B • Updated Dec 6, 2024 • 748k • 40

unsloth/Qwen3-8B-Base-unsloth-bnb-4bit

Text Generation • Updated Jul 14, 2025 • 8.78k • 5

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21, 2025 • 295k • 59

mbakgun/Qwen2.5-Coder-14B-n8n-Workflow-Generator

Text Generation • 15B • Updated Dec 28, 2025 • 1.69k • 12

LiquidAI/LFM2.5-1.2B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Jan 7 • 1.14k • 9

LiquidAI/LFM2.5-1.2B-Thinking-MLX-4bit

Text Generation • 0.2B • Updated 6 days ago • 497 • 5

Edison2ST/omniASR_CTC_300M_v2_Q4_ONNX

Updated Jan 25 • 2

nota-ai/Solar-Open-100B-NotaMoEQuant-Int4

Text Generation • Updated Jan 26 • 2.9k • 44

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated 27 days ago • 10k • 14

mlx-community/Qwen3.5-397B-A17B-4bit

Image-Text-to-Text • 62B • Updated 18 days ago • 10.1k • 7

LiquidAI/LFM2-24B-A2B-MLX-4bit

Text Generation • 24B • Updated 13 days ago • 245 • 6

catalystsec/MiniMax-M2.5-4bit-DWQ

Text Generation • 229B • Updated 17 days ago • 507 • 3

QuantTrio/Qwen3.5-397B-A17B-AWQ

Image-Text-to-Text • Updated 7 days ago • 4.64k • 6

TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-4bit

Image-Text-to-Text • 35B • Updated 6 days ago • 1.33k • 2

dealignai/Qwen3.5-397B-A17B-4bit-MLX-REAP-CRACK

Text Generation • 48B • Updated 1 day ago • 394 • 2

RepublicOfKorokke/Qwen3.5-9B-mlx-lm-mxfp4

Text Generation • 2B • Updated 6 days ago • 1.28k • 2

mlx-community/Qwen3.5-0.8B-MLX-4bit

0.2B • Updated 6 days ago • 4.7k • 2

mlx-community/Qwen3.5-35B-A3B-GPTQ-Int4

Image-Text-to-Text • 7B • Updated 5 days ago • 71 • 2

mlx-community/Huihui-Qwen3.5-35B-A3B-abliterated-mxfp4

Text Generation • 35B • Updated 4 days ago • 855 • 2

Jackrong/MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-4bit

Text Generation • 27B • Updated 4 days ago • 548 • 2

Intel/Qwen3.5-27B-int4-AutoRound

7B • Updated 4 days ago • 1.05k • 2

z-lab/Qwen3.5-4B-PARO

Image-Text-to-Text • 1B • Updated about 17 hours ago • 196 • 2

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • 33B • Updated Sep 27, 2023 • 105k • 605

TheBloke/CodeLlama-13B-GPTQ

Text Generation • 13B • Updated Sep 27, 2023 • 42 • 12

TheBloke/WizardLM-1.0-Uncensored-CodeLlama-34B-AWQ

Text Generation • 34B • Updated Nov 9, 2023 • 10 • 3

TheBloke/openchat_3.5-AWQ

Text Generation • 7B • Updated Nov 9, 2023 • 97 • 15

TheBloke/llama2-7B-layla-AWQ

Text Generation • 7B • Updated Nov 20, 2023 • 7 • 1

MaziyarPanahi/v1olet_marcoroni-go-bruins-merge-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 52 • 1

MaziyarPanahi/v1olet_marcoroni-go-bruins-merge-7B-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 70 • 1