_model_setup_1.png" /></p>
<p>chat room interface:</p>
<p><img alt="" src="../img/docker_model_setup_2.png" /></p>
<h3 id="3-taide">3. TAIDE</h3>
<ol>
<li>Download the TAIDE 8B 4bit version gguf file <code>taide-8b-a.3-q4_k_m.gguf</code> based on Llama3 from <a href="https://huggingface.co/taide/Llama3-TAIDE-LX-8B-Chat-Alpha1-4bit/tree/main">here</a>.</li>
</ol>
<p>```sh=
cd ~
mkdir gguf/taide
curl -L -o "taide/taide-8b-a.3-q4_k_m.gguf" https://huggingface.co/nctu6/Llama3-TAIDE-LX-8B-Chat-Alpha1-GGUF/resolv