Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

587

Full-text search

Active filters: AWQ

hiauiarau/RuadaptQwen2.5-32B-Pro-Beta-AWQ

Text Generation • 6B • Updated Feb 9 • 40 • 2

JohnConnor123/RuadaptQwen2.5-14B-Instruct-1M-AWQ-64G-INT4-vGEMM

Text Generation • 3B • Updated Feb 26 • 3

dangvansam/gemma-2-9b-it-fix-system-role-awq

Text Generation • 2B • Updated Mar 8 • 783

Sumo10/Phi-4-mini-instruct-AWQ-4bit

1B • Updated Apr 25 • 20 • 1

Sumo10/Llama-3.2-3B-Instruct-AWQ-4bit

0.8B • Updated Apr 25 • 2

Goraint/QwQ-32b-MLX-AWQ-4bit

Text Generation • 5B • Updated May 15 • 17

winninghealth/WiNGPT-Babel-2-AWQ

Translation • 0.9B • Updated Jun 13 • 68 • 1

cashlion/deepseek-r1-0528-qwen3-8b-mlx-awq

Text Generation • 1B • Updated Jun 28 • 277 • 1

dengcao/GLM-4.1V-9B-Thinking-AWQ

Image-Text-to-Text • 3B • Updated 24 days ago • 1.46k • 1

cashlion/OpenCodeReasoning-Nemotron-1.1-32B-AWQ

Text Generation • 33B • Updated 5 days ago • 313 • 3

QuantTrio/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 33B • Updated 4 days ago • 130

QuantTrio/GLM-4.1V-9B-Thinking-AWQ

Text Generation • 3B • Updated 8 days ago • 75

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-AWQ

Text Generation • 66B • Updated 4 days ago • 570

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 33B • Updated 4 days ago • 400

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ-BF16Mix

Text Generation • 9B • Updated about 19 hours ago

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ

Text Generation • 5B • Updated about 18 hours ago

QuantTrio/KAT-V1-40B-GPTQ-Int4-Int8Mix

Text Generation • 8B • Updated about 18 hours ago