gemma-3-4b-gguf / README.md
doberst's picture
Update README.md
e703dee verified
metadata
license: gemma
inference: false
base_model: google/gemma-3-4b
base_model_relation: quantized
tags:
  - green
  - p4
  - llmware-chat
  - gguf

gemma-3-4b-gguf

gemma-3-4b-gguf is an GGUF Q4_K quantized version of Google's Gemma-3-4B with Instruct Training (IT), providing a very fast, very small inference implementation, optimized for AI PCs using Intel GPU, CPU and NPU.

gemma-3-4b is a leading open source foundation model from Google.

Model Description

  • Developed by: Google
  • Quantized by: llmware
  • Model type: gemma-3
  • Parameters: 4 billion
  • Model Parent: google/gemma-4b-it
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: General purpose chat
  • RAG Benchmark Accuracy Score: NA
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website