Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

14

Full-text search

Active filters: 量化修复

koushd/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 33B • Updated 5 days ago • 554 • 4

model-scope/glm-4-9b-chat-GPTQ-Int4

Text Generation • 2B • Updated Jul 17, 2024 • 9 • 6

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • 3B • Updated Jul 23, 2024 • 7 • 2

QuantTrio/Qwen3-235B-A22B-GPTQ-Int8

Text Generation • Updated Jun 1 • 48

QuantTrio/DeepSeek-R1-0528-Qwen3-8B-GPTQ-Int4-Int8Mix

Text Generation • 2B • Updated May 30 • 1.11k • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Lite

Text Generation • Updated Jun 4 • 116 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Compact

Text Generation • Updated Jun 19 • 961 • 1

QuantTrio/DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium

Text Generation • Updated Jun 20 • 832 • 1

QuantTrio/Qwen3-235B-A22B-Instruct-2507-GPTQ-Int4-Int8Mix

Text Generation • Updated 3 days ago • 318

QuantTrio/Qwen3-235B-A22B-Instruct-2507-AWQ

Text Generation • 33B • Updated about 9 hours ago • 68

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-AWQ

Text Generation • 66B • Updated about 8 hours ago • 222

QuantTrio/Qwen3-Coder-480B-A35B-Instruct-GPTQ-Int4-Int8Mix

Text Generation • Updated about 8 hours ago • 55

QuantTrio/Qwen3-235B-A22B-Thinking-2507-AWQ

Text Generation • 33B • Updated about 9 hours ago • 207

QuantTrio/Qwen3-235B-A22B-Thinking-2507-GPTQ-Int4-Int8Mix

Text Generation • Updated about 8 hours ago • 48