Hugging Face's logo

unsloth
/
Llama-3.1-8B-Instruct-GGUF

Text Generation
GGUF
PyTorch
llama
facebook
meta
llama-3
conversational
Model card Files
xet
Community
danielhanchen commited on
Commit
cad44fa
·
verified ·
1 Parent(s): 918a0c0

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +1 -0
  2. Llama-3.1-8B-Instruct-IQ4_NL.gguf +1 -1
  3. Llama-3.1-8B-Instruct-IQ4_XS.gguf +1 -1
  4. Llama-3.1-8B-Instruct-Q2_K_L.gguf +1 -1
  5. Llama-3.1-8B-Instruct-Q3_K_S.gguf +3 -0
  6. Llama-3.1-8B-Instruct-Q4_0.gguf +1 -1
  7. Llama-3.1-8B-Instruct-Q4_1.gguf +1 -1
.gitattributes CHANGED
@@ -56,3 +56,4 @@ Llama-3.1-8B-Instruct-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
  Llama-3.1-8B-Instruct-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
57
  Llama-3.1-8B-Instruct-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
58
  Llama-3.1-8B-Instruct-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
56
  Llama-3.1-8B-Instruct-UD-Q5_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
57
  Llama-3.1-8B-Instruct-UD-Q6_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
58
  Llama-3.1-8B-Instruct-UD-Q8_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
59
+ Llama-3.1-8B-Instruct-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.1-8B-Instruct-IQ4_NL.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:264ea1441f90b50e768fcb83cbf7601110e9a7534c7098f53ff5da10fcb928e1
3
  size 4677993856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c76ecbe29adfdb074fc04abf582cd53463c62d6b5f21a36f045616b2cf0b96d1
3
  size 4677993856
Llama-3.1-8B-Instruct-IQ4_XS.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02fefb42e57eac9dbd72a3af4be1e1dc40743349b0217fbc643f08210d218bbc
3
  size 4464084352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bfbfeac3e1e589193da037e682ffb76730a30e787278d30a846bddcd194913f
3
  size 4464084352
Llama-3.1-8B-Instruct-Q2_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:343e179b2300a08623730ff6e35864ca0f3658ea44d320673bbb968b271ab643
3
  size 3302262144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:327717f89ea7210c87ebedab3eb35ae3b1181fbe9bd4cb5bb31832609987fe7a
3
  size 3302262144
Llama-3.1-8B-Instruct-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b38d222dee6a0df52f3a0dbea33cd6993005ff0b74255147053473ecc56374c1
3
+ size 3664504192
Llama-3.1-8B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:401ce0ec0cf14ab76653827800af4acefa1c4bb97f1b64a5ec7a9034e2b6e874
3
  size 4675896704
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88e2c6002459f892d77c7e5e219868ef08a57c4e92354c7271aaf64f47ab0eaa
3
  size 4675896704
Llama-3.1-8B-Instruct-Q4_1.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6eed85da1ecee99420207c7400f0236a8ed27ca30448aacbb380430327735893
3
  size 5130257792
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:50ebdab3bc5a529daf03b6755ac480042519eb2c3b14b2c4e9901665c8e889a0
3
  size 5130257792