Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

120

Full-text search

Active filters: exllamav2

TheMelonGod/granite-3.1-8b-instruct-exl2

Text Generation • Updated Feb 5 • 21

altomek/Mistral-Small-24B-Instruct-2501-8bpw-EXL2

Updated Feb 7 • 5

Alissonerdx/exllamav2-0.2.7-cu12.8.0.torch2.7.0-cp312-cp312-linux_x86_64

cgus/granite-3.2-8b-instruct-preview-exl2

Text Generation • Updated Feb 9 • 6

cgus/granite-guardian-3.1-8b-exl2

Text Generation • Updated Feb 26 • 4

TheMelonGod/AceInstruct-7B-exl2

Text Generation • Updated Feb 16 • 2

cgus/granite-3.2-2b-instruct-exl2

Text Generation • Updated Feb 26 • 4

cgus/granite-3.2-8b-instruct-exl2

Text Generation • Updated Feb 27 • 6

cgus/granite-guardian-3.2-5b-exl2

Text Generation • Updated Mar 2 • 4

cgus/granite-3.1-8b-Reasoning-exl2

Text Generation • Updated Mar 5 • 5

TheMelonGod/Captain-Eris_Violet-GRPO-v0.420-exl2

Text Generation • Updated Mar 10 • 4

cgus/granite-3.2-8b-instruct-abliterated-exl2

Text Generation • Updated Mar 10 • 6

TheMelonGod/Captain-Eris-BMO_Violent-GRPO-v0.420-exl2

Text Generation • Updated Mar 13 • 11

tokutsu/japanese-answer-13b-8bit

Updated Apr 21 • 1

TheMelonGod/14B-Qwen2.5-Freya-x1-exl2

Text Generation • Updated Mar 16

TheMelonGod/miscii-14b-0218-exl2

Text Generation • Updated Mar 21 • 5 • 1

cgus/Galactic-Qwen-14B-Exp2-exl2

Text Generation • Updated Mar 18 • 2

cgus/Mistral-Small-3.1-DRAFT-0.5B-exl2

Text Generation • Updated Mar 24 • 30 • 1

TheMelonGod/Qwen2.5-7B-Rebase-exl2

Text Generation • Updated Mar 26

TheMelonGod/lb-reranker-0.5B-v1.0-exl2

Text Generation • Updated Apr 15

cgus/DeepCoder-14B-Preview-exl2

Text Generation • Updated Apr 10 • 4 • 2

cgus/ZR1-1.5B-exl2

Text Generation • Updated Apr 12 • 6 • 1

cgus/SAINEMO-reMIX-exl2

Updated Apr 14 • 10 • 1

cgus/NekoMix-12B-exl2

Updated Apr 14 • 2

cgus/DeepScaleR-1.5B-Preview-exl2

Text Generation • Updated Apr 15 • 3

cgus/DeepCoder-1.5B-Preview-exl2

Text Generation • Updated Apr 15 • 6

cgus/cogito-v1-preview-qwen-14B-exl2

Text Generation • Updated Apr 17 • 8 • 1

cgus/YOYO-O1-14B-exl2

Text Generation • Updated Apr 18 • 3

cgus/granite-3.3-8b-instruct-exl2

Text Generation • Updated Apr 16 • 5

TheMelonGod/ZR1-1.5B-exl2

Text Generation • Updated Apr 18 • 3