Update README.md
Browse files
README.md
CHANGED
|
@@ -26,7 +26,7 @@ Merged 16bit.
|
|
| 26 |
max_seq_length = 4096
|
| 27 |
|
| 28 |
LoRA r: 64 -> 2.26% of all Params
|
| 29 |
-
LoRA alpha: 128
|
| 30 |
Training: 1 epoch (187 steps)
|
| 31 |
|
| 32 |
RAG Skills pretty damn good. Next one will be probably a A+RAG model.
|
|
|
|
| 26 |
max_seq_length = 4096
|
| 27 |
|
| 28 |
LoRA r: 64 -> 2.26% of all Params
|
| 29 |
+
LoRA alpha: 128
|
| 30 |
Training: 1 epoch (187 steps)
|
| 31 |
|
| 32 |
RAG Skills pretty damn good. Next one will be probably a A+RAG model.
|