-
-
-
-
-
-
Inference Providers
Active filters:
3-bit
mlx-community/Qwen3-235B-A22B-Instruct-2507-3bit-DWQ
Text Generation
•
235B
•
Updated
•
295
•
4
mlx-community/Qwen3-235B-A22B-Thinking-2507-3bit-DWQ
Text Generation
•
235B
•
Updated
•
236
•
4
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
243k
•
17
MaziyarPanahi/Phi-4-mini-instruct-GGUF
Text Generation
•
4B
•
Updated
•
195k
•
7
MaziyarPanahi/Qwen3-4B-GGUF
Text Generation
•
4B
•
Updated
•
193k
•
5
mlx-community/Qwen3-235B-A22B-3bit-DWQ
Text Generation
•
37B
•
Updated
•
1.08k
•
5
MaziyarPanahi/ChatMusician-GGUF
Text Generation
•
7B
•
Updated
•
136
•
15
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
7B
•
Updated
•
222k
•
108
MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF
Text Generation
•
3B
•
Updated
•
191k
•
14
MaziyarPanahi/phi-4-GGUF
Text Generation
•
15B
•
Updated
•
198k
•
5
MaziyarPanahi/gemma-3-1b-it-GGUF
Text Generation
•
1.0B
•
Updated
•
209k
•
6
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
•
4B
•
Updated
•
197k
•
9
MaziyarPanahi/DeepHermes-3-Llama-3-3B-Preview-abliterated-GGUF
Text Generation
•
3B
•
Updated
•
29
•
1
MaziyarPanahi/Qwen3-0.6B-GGUF
Text Generation
•
0.8B
•
Updated
•
191k
•
4
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
•
2B
•
Updated
•
194k
•
2
MaziyarPanahi/Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
191k
•
3
MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation
•
8B
•
Updated
•
193k
•
6
ReadyArt/Steelskull_L3.3-MS-Nevoria-70b_EXL3_3.0bpw_H6
Text Generation
•
14B
•
Updated
•
9
•
1
mlx-community/Qwen3-235B-A22B-Thinking-2507-3bit
Text Generation
•
235B
•
Updated
•
198
•
1
mlx-community/GLM-4.5-Air-3bit
Text Generation
•
107B
•
Updated
•
1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
•
Updated
•
4
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
•
Updated
•
5
•
3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
•
Updated
•
5
•
3
MiNeves-TensorOps/opt-125m-gptq-3bit
Text Generation
•
Updated
•
4
Kimata/opt-125m-3bit
Text Generation
•
Updated
•
4
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
•
Updated
•
10
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
•
0.9B
•
Updated
•
4
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
•
0.9B
•
Updated
•
8
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
•
0.7B
•
Updated
•
4
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
•
0.7B
•
Updated
•
4