Models

RedHatAI/gemma-3-27b-it-FP8-dynamic

Image-Text-to-Text • 27B • Updated Jun 9 • 15.9k • 5

Qwen/Qwen3-235B-A22B-FP8

Text Generation • 235B • Updated 3 days ago • 99.4k • • 81

BCCard/Qwen2.5-VL-32B-Instruct-FP8-Dynamic

Image-to-Text • 33B • Updated Jun 20 • 172k • 2

unsloth/Qwen3-30B-A3B-FP8

Text Generation • 31B • Updated May 11 • 29 • 1

phazei/phazei-SkyReels-V2-fp8-e5m2

Text-to-Video • Updated May 25 • 2

unsloth/DeepSeek-R1-0528-GGUF

Text Generation • 671B • Updated Jun 15 • 110k • 182

stelterlab/Mistral-Small-3.2-24B-Instruct-2506-FP8

Image-Text-to-Text • Updated Jun 26 • 7.28k • 4

unsloth/Qwen3-235B-A22B-Instruct-2507-FP8

Text Generation • 235B • Updated 8 days ago • 126 • 2

unsloth/Qwen3-235B-A22B-Thinking-2507-FP8

Text Generation • 235B • Updated 4 days ago • 57 • 1

FriendliAI/Meta-Llama-3-8B-Instruct-fp8

Text Generation • 8B • Updated Nov 3, 2024 • 31 • 2

nm-testing/mistral-fp8-dynamic

Text Generation • 7B • Updated Apr 26, 2024 • 7

nm-testing/mistral-fp8-static

Text Generation • 7B • Updated Apr 26, 2024 • 3

nm-testing/opt-125m-fp8-static

Text Generation • 0.1B • Updated Apr 26, 2024 • 6

RedHatAI/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated Jul 18, 2024 • 3.6k • • 23

RedHatAI/Mixtral-8x7B-Instruct-v0.1-AutoFP8

Text Generation • 47B • Updated Jul 18, 2024 • 15 • 3

nm-testing/opt-125m-fp8-dynamic

Text Generation • 0.1B • Updated Apr 27, 2024 • 5

anyisalin/Meta-Llama-3-8B-Instruct-FP8

Text Generation • 8B • Updated May 6, 2024 • 4

anyisalin/Meta-Llama-3-8B-Instruct-FP8-D

Text Generation • 8B • Updated Apr 28, 2024 • 4

anyisalin/lzlv_70b_fp16_hf-FP8-D

Text Generation • 69B • Updated Apr 28, 2024 • 5

anyisalin/Meta-Llama-3-70B-Instruct-FP8-D

Text Generation • 71B • Updated Apr 28, 2024 • 4

anyisalin/Mixtral-8x7B-Instruct-v0.1-FP8-D

Text Generation • 47B • Updated Apr 28, 2024 • 6

nm-testing/llama-3-instruct-fp8-static-shared-scales

Text Generation • 8B • Updated Apr 28, 2024 • 9

nm-testing/llama-3-instruct-fp8-dynamic-shared-scales

Text Generation • 8B • Updated Apr 28, 2024 • 4

pcmoritz/Mixtral-8x7B-v0.1-fp8-act-scale

Text Generation • 47B • Updated May 2, 2024 • 6

anyisalin/Meta-Llama-3-70B-Instruct-FP8

Text Generation • 71B • Updated May 8, 2024 • 4

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • 8B • Updated Jun 19, 2024 • 4.28k • • 8

comaniac/Meta-Llama-3-8B-Instruct-FP8-v1

Text Generation • 8B • Updated May 24, 2024 • 3

comaniac/Mixtral-8x22B-Instruct-v0.1-FP8-v1

Text Generation • 141B • Updated May 28, 2024 • 7

RedHatAI/Meta-Llama-3-70B-Instruct-FP8

Text Generation • 71B • Updated Jul 18, 2024 • 2.55k • • 13

comaniac/Meta-Llama-3-70B-Instruct-FP8-v1

Text Generation • 71B • Updated May 26, 2024 • 5