Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
PowerInfer
/
SmallThinker-21BA3B-Instruct-GGUF
like
34
Follow
PowerInfer
381
Text Generation
GGUF
English
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
3
Deploy
Use this model
aaa8d86
SmallThinker-21BA3B-Instruct-GGUF
122 GB
3 contributors
History:
8 commits
BLGS
Upload SmallThinker-21B-A3B-Instruct.Q4_1.gguf with huggingface_hub
aaa8d86
verified
3 months ago
.gitattributes
1.97 kB
Upload SmallThinker-21B-A3B-Instruct.Q4_1.gguf with huggingface_hub
3 months ago
README.md
Safe
5.18 kB
Update README.md
3 months ago
SmallThinker-21B-A3B-Instruct.F16.gguf
43 GB
xet
Upload SmallThinker-21B-A3B-Instruct.F16.gguf with huggingface_hub
3 months ago
SmallThinker-21B-A3B-Instruct.Q4_0.gguf
Safe
12.2 GB
xet
Upload SmallThinker-21B-A3B-Instruct.Q4_0.gguf with huggingface_hub
3 months ago
SmallThinker-21B-A3B-Instruct.Q4_1.gguf
13.6 GB
xet
Upload SmallThinker-21B-A3B-Instruct.Q4_1.gguf with huggingface_hub
3 months ago
SmallThinker-21B-A3B-Instruct.Q4_K.gguf
13.1 GB
xet
Upload SmallThinker-21B-A3B-Instruct.Q4_K.gguf with huggingface_hub
3 months ago
SmallThinker-21B-A3B-Instruct.Q6_K.gguf
17.7 GB
xet
Upload SmallThinker-21B-A3B-Instruct.Q6_K.gguf with huggingface_hub
3 months ago
SmallThinker-21B-A3B-Instruct.Q8_0.gguf
Safe
22.9 GB
xet
Upload SmallThinker-21B-A3B-Instruct.Q8_0.gguf with huggingface_hub
3 months ago
