Update README.md
Browse files
README.md
CHANGED
|
@@ -113,7 +113,7 @@ license_name: llama4
|
|
| 113 |
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
| 114 |
</a>
|
| 115 |
</div>
|
| 116 |
-
<h1 style="margin-top: 0rem;"
|
| 117 |
</div>
|
| 118 |
<p style="margin-bottom: 0;">
|
| 119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
|
@@ -128,6 +128,16 @@ license_name: llama4
|
|
| 128 |
|3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|
|
| 129 |
|4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|Best|
|
| 130 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 131 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
| 132 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
| 133 |
- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
|
|
|
|
| 113 |
<img src="https://raw.githubusercontent.com/unslothai/unsloth/refs/heads/main/images/documentation%20green%20button.png" width="143">
|
| 114 |
</a>
|
| 115 |
</div>
|
| 116 |
+
<h1 style="margin-top: 0rem;">🦙 Run Unsloth Dynamic Llama 4!</h1>
|
| 117 |
</div>
|
| 118 |
<p style="margin-bottom: 0;">
|
| 119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
|
|
|
| 128 |
|3.5-bit|Q3\_K\_XL|**52.9GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ3_K_XL)|Great|
|
| 129 |
|4.5-bit|Q4\_K\_XL|**65.6GB**|[Link](https://huggingface.co/unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF/tree/main/UD-IQ4_K_XL)|Best|
|
| 130 |
|
| 131 |
+
**Chat template/prompt format:**
|
| 132 |
+
```
|
| 133 |
+
<|begin_of_text|><|header_start|>system<|header_end|>
|
| 134 |
+
|
| 135 |
+
{system_prompt}<|eot|><|header_start|>user<|header_end|>
|
| 136 |
+
|
| 137 |
+
{prompt}<|eot|><|header_start|>assistant<|header_end|>
|
| 138 |
+
```
|
| 139 |
+
|
| 140 |
+
# 🦙 Fine-tune Llama 4 with Unsloth!
|
| 141 |
- Fine-tune Llama-4-Scout on a single H100 80GB GPU using Unsloth!
|
| 142 |
- Read our Blog about Llama 4 support: [unsloth.ai/blog/llama4](https://unsloth.ai/blog/llama4)
|
| 143 |
- View the rest of our notebooks in our [docs here](https://docs.unsloth.ai/get-started/unsloth-notebooks).
|