Hugging Face's logo

unsloth
/
QwQ-32B-GGUF

Text Generation
GGUF
English
qwen2
chat
qwen
imatrix
conversational
Model card Files
xet
Community
11
danielhanchen commited on
Commit
58a223e
·
verified ·
1 Parent(s): 4b9740e

Add files using upload-large-folder tool

Browse files
Files changed (7) hide show
  1. .gitattributes +2 -0
  2. QwQ-32B-Q2_K.gguf +2 -2
  3. QwQ-32B-Q3_K_M.gguf +2 -2
  4. QwQ-32B-Q4_K_M.gguf +2 -2
  5. QwQ-32B-Q6_K.gguf +2 -2
  6. QwQ-32B-UD-IQ2_XXS.gguf +3 -0
  7. QwQ-32B-UD-Q3_K_XL.gguf +3 -0
.gitattributes CHANGED
@@ -48,3 +48,5 @@ QwQ-32B-UD-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
48
  QwQ-32B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
49
  QwQ-32B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
50
  QwQ-32B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
48
  QwQ-32B-UD-Q2_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
49
  QwQ-32B-UD-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
50
  QwQ-32B-UD-Q4_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
51
+ QwQ-32B-UD-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
52
+ QwQ-32B-UD-Q3_K_XL.gguf filter=lfs diff=lfs merge=lfs -text
QwQ-32B-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:abb3e6ab4cfd316ce2470f2eecdbee30bdc4fcff8e77d5151565c8aac1e7399d
3
- size 12313098432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:501cf627fff433dca274f1a40e73487d0b85c01ed34537c43ab7b62040f4b54a
3
+ size 12313098848
QwQ-32B-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8803191bbabcc23ff0dabdc4056b8bc5e00fb0816cd0ac8b7c7a04fd3381e192
3
- size 15935047872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51deb058b86816a0a348031994cce68ee93153403b7617ab524de0269f2ab8e2
3
+ size 15935048288
QwQ-32B-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2a57a952d3d7469581ff623863992b1baadff060aa9a88cba092206f92efadfb
3
- size 19851335872
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:39dc40d34d44d66406e9ad94416585839daa5edc35425f6f6925c35e149aa5f5
3
+ size 19851336288
QwQ-32B-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:052d192729c2557ec95cfe4a5db7c5c2b68970a2585e0be41201fb29543b8e87
3
- size 26886154432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75d046a0d9ed53a596086e9b7a46ca6108bf1964a931cf5dee2404dd5f323b57
3
+ size 26886154848
QwQ-32B-UD-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dde2f99a431ae8dd14652f96c85855a1b07831de6a0e8b03b11af78af4ec7789
3
+ size 9336801888
QwQ-32B-UD-Q3_K_XL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:74e2a8d422bd7cc1999789032dfff33a0f68e29772639de4991d0843af1db727
3
+ size 16321034848