Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

112

Full-text search

Active filters: int4

ModelCloud/QwQ-32B-gptqmodel-4bit-vortex-v1

Text Generation • 7B • Updated Mar 9 • 20 • 11

tensorblock/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16-GGUF

Updated 21 days ago • 146

FunAGI/LLaDA-8B-Base-gptqmodel-4bit

Text Generation • 2B • Updated Mar 15 • 36 • 1

rpanchum/jais-13b-int4-sym-ov

Text Generation • Updated Mar 10 • 2

rpanchum/falcon3-7b-instruct-int4-sym-ov

Text Generation • Updated Mar 10 • 3

FunAGI/LLaDA-8B-Instruct-gptqmodel-4bit

Text Generation • Updated Mar 15 • 29 • 4

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g

Image-Text-to-Text • 5B • Updated Apr 6 • 2.64k • 14

FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit

Any-to-Any • 5B • Updated Mar 28 • 29 • 53

RedHatAI/whisper-large-v3-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 47

RedHatAI/whisper-large-v2-quantized.w4a16

Automatic Speech Recognition • 0.3B • Updated Apr 22 • 22 • 1

RedHatAI/whisper-large-v3-turbo-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated Apr 22 • 1.02k • 3

RedHatAI/whisper-medium-quantized.w4a16

Automatic Speech Recognition • 0.2B • Updated Apr 22 • 2

RedHatAI/whisper-small-quantized.w4a16

Automatic Speech Recognition • 0.1B • Updated Apr 22 • 43 • 1

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 5B • Updated May 30 • 2.4k • 6

prashantarya/orpheus-tts-shaurya-4bit-new

Text Generation • Updated May 2 • 2

jsbaicenter/r1-1776-distill-llama-70b-GPTQ-4bit

Text Generation • 11B • Updated May 13 • 2

CarlOwOs/Qwen3-0.6B-Base-int4

Text Generation • 0.5B • Updated Jun 5 • 2

nikodoz/qwen2.5-7b-instruct-int4

Text Generation • 4B • Updated Jun 10 • 1 • 1

Prince-1/Veena-Onnx-Int4

Text-to-Speech • Updated Jun 26

liuming9157/Wan2.1-T2V-1.3B-Diffusers-ov-int4

Text-to-Video • Updated 20 days ago

cuongpp/gemma-3-12b-it-GPTQ-4bit

Image-Text-to-Text • 3B • Updated 15 days ago • 218

samuelt0207/quantize_wan

Updated 10 days ago • 2