Hugging Face's logo

Spaces:
Akbartus
/
LLaMACpp-GGUF-Vision-Smoll-VLM-2.2b-Docker
Sleeping

App Files Community
Akbartus commited on
Commit
4c5fd6e
·
verified ·
1 Parent(s): b1ec4ee

Update Dockerfile

Browse files
Files changed (1) hide show
  1. Dockerfile +2 -2
Dockerfile CHANGED
@@ -2,8 +2,8 @@ FROM ghcr.io/ggerganov/llama.cpp:full
2
 
3
  RUN apt update && apt install wget -y
4
  # Download the GGUF file for ggml-org/gemma-3-4b-it-GGUF
5
- RUN wget "https://huggingface.co/ggml-org/SmolVLM-500M-Instruct-GGUF/resolve/main/SmolVLM-500M-Instruct-f16.gguf" -O /smoll.gguf
6
  # Download the mmproj file for ggml-org/gemma-3-4b-it-GGUF
7
- RUN wget "https://huggingface.co/ggml-org/SmolVLM-500M-Instruct-GGUF/resolve/main/mmproj-SmolVLM-500M-Instruct-f16.gguf" -O /mmproj.gguf
8
 
9
  CMD ["--server", "-m", "/smoll.gguf", "--mmproj", "/mmproj.gguf", "--port", "7860", "--host", "0.0.0.0", "-n", "512"]
 
2
 
3
  RUN apt update && apt install wget -y
4
  # Download the GGUF file for ggml-org/gemma-3-4b-it-GGUF
5
+ RUN wget "https://huggingface.co/ggml-org/SmolVLM2-2.2B-Instruct-GGUF/resolve/main/SmolVLM2-2.2B-Instruct-Q8_0.gguf" -O /smoll.gguf
6
  # Download the mmproj file for ggml-org/gemma-3-4b-it-GGUF
7
+ RUN wget "https://huggingface.co/ggml-org/SmolVLM2-2.2B-Instruct-GGUF/resolve/main/mmproj-SmolVLM2-2.2B-Instruct-Q8_0.gguf" -O /mmproj.gguf
8
 
9
  CMD ["--server", "-m", "/smoll.gguf", "--mmproj", "/mmproj.gguf", "--port", "7860", "--host", "0.0.0.0", "-n", "512"]