gaunernst
/

gemma-3-12b-it-int4-awq

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

gaunernst commited on Apr 6

Commit

3b0c67b

·

verified ·

1 Parent(s): 6fc5e4e

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -14,6 +14,8 @@ base_model: google/gemma-3-12b-it
 This is the QAT INT4 Flax checkpoint (from Kaggle) converted to HF+AWQ format for ease of use. AWQ was NOT used for quantization. You can find the conversion script `convert_flax.py` in this model repo.
 Below is the original Model card from https://huggingface.co/google/gemma-3-12b-it
 # Gemma 3 model card

 This is the QAT INT4 Flax checkpoint (from Kaggle) converted to HF+AWQ format for ease of use. AWQ was NOT used for quantization. You can find the conversion script `convert_flax.py` in this model repo.
+NOTE: this is NOT the same as the official QAT INT4 GGUFs released here https://huggingface.co/collections/google/gemma-3-qat-67ee61ccacbf2be4195c265b
 Below is the original Model card from https://huggingface.co/google/gemma-3-12b-it
 # Gemma 3 model card