&lt;gguf file name&gt;" ......</code></li>
<li>
<p>line 17: change <code>["/path/to/taide/model.gguf</code> to your path to the gguf file, and change <code>/var/model/taide-4bit.gguf</code> to <code>/var/model/&lt;gguf file name&gt;</code></p>
</li>
<li>
<p>Edit <code>run.sh</code>:</p>
</li>
</ol>
<p>Add <code>&lt;yaml file name&gt;</code> into <code>confs</code> array and execute <code>run.sh</code> again.</p>
              
            </div>
          </div><footer>
    <div class="rst-footer-buttons" r