TheBloke
/

sheep-duck-llama-2-70B-v1.1-GGUF

Model card Files Files and versions

sheep-duck-llama-2-70B-v1.1-GGUF

521 GB

1 contributor

History: 16 commits

TheBloke's picture

Upload README.md

347549d about 2 years ago

.gitattributes

2.6 kB

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit f5ef5cf) about 2 years ago
LICENSE.txt

7.02 kB

Add Llama 2 license files about 2 years ago
Notice

112 Bytes

Add Llama 2 license files about 2 years ago
README.md

18.3 kB

Upload README.md about 2 years ago
USE_POLICY.md

4.77 kB

Add Llama 2 license files about 2 years ago
config.json

29 Bytes

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q2_K.gguf

29.3 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q3_K_L.gguf

36.1 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q3_K_M.gguf

33.2 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q3_K_S.gguf

29.9 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q4_0.gguf

38.9 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q4_K_M.gguf

41.4 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q4_K_S.gguf

39.1 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q5_0.gguf

47.5 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q5_K_M.gguf

48.8 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q5_K_S.gguf

47.5 GB
xet

GGUF model commit (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q6_K.gguf-split-a

28.3 GB
xet

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q6_K.gguf-split-b

28.3 GB
xet

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q8_0.gguf-split-a

36.6 GB
xet

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit f5ef5cf) about 2 years ago
sheep-duck-llama-2-70b-v1.1.Q8_0.gguf-split-b
36.6 GB
xet

Upload in splits of max 50GB due to HF 50GB limit. (made with llama.cpp commit f5ef5cf) about 2 years ago