These quantized models have a smaller memory footprint, but acceptable quality.
isometra
Crataco
AI & ML interests
Using my best computers to quantize LLMs for your worst computers
Organizations
None yet
models
18
Crataco/Nous-Hermes-2-Mistral-7B-DPO-imatrix-GGUF
7B
•
Updated
•
1.26k
•
5
Crataco/phi-2-orange-v2-imatrix-GGUF
3B
•
Updated
•
587
•
1
Crataco/stablelm-2-1_6b-chat-imatrix-GGUF
2B
•
Updated
•
20.7k
•
1
Crataco/cream-phi-2-v0.2-imatrix-GGUF
3B
•
Updated
•
56
•
2
Crataco/distilgpt2-82M-GGUF
0.1B
•
Updated
•
166
•
3
Crataco/TinyDolphin-2.8-1.1b-imatrix-GGUF
1B
•
Updated
•
140
•
6
Crataco/TinyDolphin-2.8.2-1.1B-laser-GGUF
1B
•
Updated
•
154
Crataco/Metharme-1.3B-GGML
Text Generation
•
Updated
Crataco/RWKV-4-PilePlus-Series-GGML
Text Generation
•
Updated
•
3
Crataco/GPT-2-Series-GGML
Text Generation
•
Updated
•
3
datasets
0
None public yet