Models

allenai/olmOCR-7B-0725-FP8

Image-to-Text • 8B • Updated 4 days ago • 3.47k • 5

RedHatAI/Qwen2.5-VL-72B-Instruct-FP8-Dynamic

Image-to-Text • 73B • Updated Apr 25 • 1.99k • 8

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-to-Text • 3B • Updated Apr 3 • 1.62k • 6

RedHatAI/Qwen3-1.7B-quantized.w4a16

Text Generation • 0.8B • Updated May 12 • 53 • 2

RedHatAI/gemma-3-27b-it-quantized.w4a16

Image-Text-to-Text • 7B • Updated Jun 9 • 3.71k • 3

ionos/Llama-3.3-70B-Instruct-FP8

Text Generation • 71B • Updated 5 days ago • 219 • 2

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated Oct 19, 2024 • 1.03k • 7

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • 71B • Updated Feb 11 • 6.48k • 21

RedHatAI/Meta-Llama-3.1-8B-FP8

Text Generation • 8B • Updated Mar 25 • 3.57k • 8

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • 71B • Updated May 30 • 7.85k • 9

RedHatAI/DeepSeek-V2.5-1210-FP8

Text Generation • 236B • Updated Jan 4 • 14 • 1

AtlaAI/Selene-1-Llama-3.3-70B-GPTQ-W8A8

Text Generation • 71B • Updated 2 days ago • 10 • 1

meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8

Image-Text-to-Text • 402B • Updated May 22 • 125k • • 123

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • 20B • Updated May 30 • 10.4k • 12

RedHatAI/gemma-3-27b-it-FP8-dynamic

Image-Text-to-Text • 27B • Updated Jun 9 • 15.8k • 5

RedHatAI/Qwen3-32B-quantized.w4a16

Text Generation • 6B • Updated May 13 • 2.46k • 8

BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Image-to-Text • 33B • Updated Jun 20 • 170k • 2

RedHatAI/gemma-3-12b-it-quantized.w8a8

Image-Text-to-Text • 13B • Updated Jun 9 • 644 • 2

boboliu/Qwen3-Reranker-0.6B-W4A16-G128

Text Classification • 0.2B • Updated Jun 7 • 251 • 1

duydq12/nomic-embed-code-FP8-dynamic

Text Generation • 8B • Updated Jun 9 • 19 • 1

allenai/olmOCR-7B-0225-preview-FP8

Image-to-Text • 8B • Updated Jun 17 • 9.44k • 10

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated Jun 26 • 5.79k • 4

RedHatAI/Qwen3-32B-NVFP4

Text Generation • 19B • Updated 27 days ago • 1.31k • 2

BAAI/RoboBrain2.0-7B-W8A16

Robotics • 3B • Updated 4 days ago • 19 • 1

RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • Updated 9 days ago • 5.77k • 6

cpatonn/OpenReasoning-Nemotron-32B-GPTQ

Text Generation • 6B • Updated 7 days ago • 40 • 1

cpatonn/KAT-V1-40B-AWQ

Text Generation • 7B • Updated 3 days ago • 28 • 1

groxaxo/Qwen3-8B-abliterated-GPTQ-W8A16

3B • Updated 1 day ago • 6 • 1

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 5

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024 • 4