Models

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Oct 19, 2024 • 1.03k • 7

mistralai/Mistral-Large-Instruct-2407

123B • Updated 3 days ago • 11.4k • 836

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Feb 11 • 6.48k • 21

RedHatAI/Meta-Llama-3.1-8B-FP8

Text Generation • 8B • Updated Mar 25 • 3.57k • 8

mradermacher/Mathstral-7B-v0.1-GGUF

7B • Updated 4 days ago • 132 • 1

mlx-community/Ministral-8B-Instruct-2410-4bit

1B • Updated Oct 17, 2024 • 176 • 9

mistralai/Mistral-Large-Instruct-2411

123B • Updated 3 days ago • 15.7k • 226

MERaLiON/MERaLiON-AudioLLM-Whisper-SEA-LION

Automatic Speech Recognition • 10B • Updated 11 days ago • 436 • 17

RedHatAI/DeepSeek-V2.5-1210-FP8

Text Generation • 236B • Updated Jan 4 • 14 • 1

RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16

Image-to-Text • 13B • Updated 17 days ago • 1.25k • 5

NousResearch/DeepHermes-3-Mistral-24B-Preview

Text Generation • 24B • Updated Mar 13 • 935 • 111

mistralai/Mistral-Small-3.1-24B-Instruct-2503

24B • Updated 3 days ago • 235k • 1.3k

mistralai/Mistral-Small-3.1-24B-Base-2503

24B • Updated 3 days ago • 9.53k • 245

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

24B • Updated May 21 • 6.25k • 80

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 20B • Updated May 30 • 10.4k • 12

BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Image-to-Text • 33B • Updated Jun 20 • 170k • 2

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • 13B • Updated Jun 9 • 644 • 2

lastmass/Qwen3_Medical_GRPO

Text Generation • 4B • Updated 3 days ago • 3.38k • 6

ramgpt/jan-nano-4b-gptqmodel-4bit

Text Generation • 0.9B • Updated Jun 20 • 265 • 2

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated Jun 26 • 5.79k • 4

RedHatAI/Qwen3-32B-NVFP4

Text Generation • 19B • Updated 27 days ago • 1.31k • 2

unsloth/Devstral-Small-2507-unsloth-bnb-4bit

Text Generation • 24B • Updated 17 days ago • 11k • 4

RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • Updated 9 days ago • 5.77k • 6

mradermacher/Qwen3_Medical_GRPO-GGUF

4B • Updated 3 days ago • 241 • 1

mradermacher/Qwen3_Medical_GRPO-i1-GGUF

4B • Updated 3 days ago • 474 • 1

unsloth/Magistral-Small-2507

24B • Updated 2 days ago • 50 • 1

unsloth/Magistral-Small-2507-unsloth-bnb-4bit

24B • Updated 2 days ago • 76 • 1

Inferless/deciLM-7B-GPTQ

Text Generation • Updated Jan 4, 2024 • 6 • 1

Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ

Text Generation • Updated Jan 4, 2024 • 6 • 2

Inferless/Mixtral-8x7B-v0.1-int8-GPTQ

Text Generation • Updated Jan 25, 2024 • 6 • 2