-
-
-
-
-
-
Inference Providers
Active filters: 4-bit
mlx-community/Qwen2.5-Coder-14B-Instruct-4bit
Text Generation
• Updated
• 1.93k
• 7
casperhansen/llama-3.3-70b-instruct-awq
Text Generation
• 71B • Updated
• 748k
• 40
unsloth/Qwen3-8B-Base-unsloth-bnb-4bit
Text Generation
• Updated
• 8.78k
• 5
Text Generation
• 15B • Updated
• 295k
• 59
mbakgun/Qwen2.5-Coder-14B-n8n-Workflow-Generator
Text Generation
• 15B • Updated
• 1.69k
• 12
LiquidAI/LFM2.5-1.2B-Instruct-MLX-4bit
Text Generation
• 0.2B • Updated
• 1.14k
• 9
LiquidAI/LFM2.5-1.2B-Thinking-MLX-4bit
Text Generation
• 0.2B • Updated
• 497
• 5
Edison2ST/omniASR_CTC_300M_v2_Q4_ONNX
nota-ai/Solar-Open-100B-NotaMoEQuant-Int4
Text Generation
• Updated
• 2.9k
• 44
Intel/Qwen3-Coder-Next-int4-AutoRound
Text Generation
• 12B • Updated
• 10k
• 14
mlx-community/Qwen3.5-397B-A17B-4bit
Image-Text-to-Text
• 62B • Updated
• 10.1k
• 7
LiquidAI/LFM2-24B-A2B-MLX-4bit
Text Generation
• 24B • Updated
• 245
• 6
catalystsec/MiniMax-M2.5-4bit-DWQ
Text Generation
• 229B • Updated
• 507
• 3
QuantTrio/Qwen3.5-397B-A17B-AWQ
Image-Text-to-Text
• Updated
• 4.64k
• 6
TheCluster/Qwen3.5-35B-A3B-Heretic-MLX-4bit
Image-Text-to-Text
• 35B • Updated
• 1.33k
• 2
dealignai/Qwen3.5-397B-A17B-4bit-MLX-REAP-CRACK
Text Generation
• 48B • Updated
• 394
• 2
RepublicOfKorokke/Qwen3.5-9B-mlx-lm-mxfp4
Text Generation
• 2B • Updated
• 1.28k
• 2
mlx-community/Qwen3.5-0.8B-MLX-4bit
0.2B • Updated
• 4.7k
• 2
mlx-community/Qwen3.5-35B-A3B-GPTQ-Int4
Image-Text-to-Text
• 7B • Updated
• 71
• 2
mlx-community/Huihui-Qwen3.5-35B-A3B-abliterated-mxfp4
Text Generation
• 35B • Updated
• 855
• 2
Jackrong/MLX-Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-4bit
Text Generation
• 27B • Updated
• 548
• 2
Intel/Qwen3.5-27B-int4-AutoRound
7B • Updated
• 1.05k
• 2
Image-Text-to-Text
• 1B • Updated
• 196
• 2
TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ
Text Generation
• 33B • Updated
• 105k
• 605
TheBloke/CodeLlama-13B-GPTQ
Text Generation
• 13B • Updated
• 42
• 12
TheBloke/WizardLM-1.0-Uncensored-CodeLlama-34B-AWQ
Text Generation
• 34B • Updated
• 10
• 3
TheBloke/openchat_3.5-AWQ
Text Generation
• 7B • Updated
• 97
• 15
TheBloke/llama2-7B-layla-AWQ
Text Generation
• 7B • Updated
• 7
• 1
MaziyarPanahi/v1olet_marcoroni-go-bruins-merge-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated
• 52
• 1
MaziyarPanahi/v1olet_marcoroni-go-bruins-merge-7B-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated
• 70
• 1