Granite 3.3 8b Instruct FP8

This repository contains the FP8 version of Granite-3.3-8b-Instruct.

Please reference the base model's full model card here: https://huggingface.co/ibm-granite/granite-3.3-8b-instruct

Downloads last month: 5,927

Safetensors

Model size

8B params

Tensor type

BF16

F8_E4M3

Model tree for ibm-granite/granite-3.3-8b-instruct-FP8

Base model

ibm-granite/granite-3.3-8b-base

Finetuned

ibm-granite/granite-3.3-8b-instruct

Quantized

(34)

this model

Space using ibm-granite/granite-3.3-8b-instruct-FP8 1

Collection including ibm-granite/granite-3.3-8b-instruct-FP8

Granite Quantized Models

Collection

Quantized versions of IBM Granite models. Licensed under the Apache 2.0 license. • 44 items • Updated Nov 21, 2025 • 32