---
license: apache-2.0
---

4-bit [OmniQuant](https://arxiv.org/abs/2308.13137) quantized version of [TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0).