unsloth
/

llama-3-8b-bnb-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

danielhanchen commited on Apr 18, 2024

Commit

0480a64

·

verified ·

1 Parent(s): 63b9ca5

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ tags:
 # Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!
-Directly quantized 4bit model with `bitsandbytes`.
 We have a Google Colab Tesla T4 notebook for Llama-3 8b here: https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing

 # Finetune Mistral, Gemma, Llama 2-5x faster with 70% less memory via Unsloth!
+Directly quantized 4bit model with `bitsandbytes`. Built with Meta Llama 3
 We have a Google Colab Tesla T4 notebook for Llama-3 8b here: https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing