owao commited on
Commit
a89ebe2
·
verified ·
1 Parent(s): 1496852

added min-p 0.05 to the suggested command

Browse files

I'm suggesting this because I observed a huge difference in output quality if set to 0, and that's what openwebui sets by default, instead of 0.05 like `llama-server`). So I think it's better to explicitly set it.

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -11,7 +11,7 @@ library_name: transformers
11
  > [!NOTE]
12
  > <br> If you are using `llama.cpp`, use `--jinja`
13
  > ```bash
14
- > ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --repeat-penalty 1.05
15
  > ```
16
  <div>
17
  <p style="margin-top: 0;margin-bottom: 0;">
 
11
  > [!NOTE]
12
  > <br> If you are using `llama.cpp`, use `--jinja`
13
  > ```bash
14
+ > ./llama.cpp/llama-cli -hf unsloth/Hunyuan-A13B-Instruct-GGUF:Q4_K_XL -ngl 99 --jinja --temp 0.7 --top-k 20 --top-p 0.8 --min-p 0.05 --repeat-penalty 1.05
15
  > ```
16
  <div>
17
  <p style="margin-top: 0;margin-bottom: 0;">