added min-p 0.05 to the suggested command
Browse filesI'm suggesting this because I observed a huge difference in output quality if set to 0, and that's what openwebui sets by default, instead of 0.05 like `llama-server`). So I think it's better to explicitly set it.
README.md
CHANGED
|
@@ -11,7 +11,7 @@ library_name: transformers
|
|
| 11 |
> [!NOTE]
|
| 12 |
> <br> If you are using `llama.cpp`, use `--jinja`
|
| 13 |
> ```bash
|
| 14 |
-
> ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --repeat-penalty 1.05
|
| 15 |
> ```
|
| 16 |
<div>
|
| 17 |
<p style="margin-top: 0;margin-bottom: 0;">
|
|
|
|
| 11 |
> [!NOTE]
|
| 12 |
> <br> If you are using `llama.cpp`, use `--jinja`
|
| 13 |
> ```bash
|
| 14 |
+
> ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --min-p 0.05 --repeat-penalty 1.05
|
| 15 |
> ```
|
| 16 |
<div>
|
| 17 |
<p style="margin-top: 0;margin-bottom: 0;">
|