jusjinuk/gemma-3-27b-it-2bit-GuidedQuant-LNQ
Updated
• 7
Instruction-tuned models (GuidedQuant)
-
-
jusjinuk/gemma-3-27b-it-3bit-GuidedQuant-LNQ
Updated • 1 -
jusjinuk/gemma-3-27b-it-4bit-GuidedQuant-LNQ
Updated • 1 -
jusjinuk/Qwen3-32B-2bit-GuidedQuant-LNQ
Updated • 2 -
jusjinuk/Qwen3-32B-3bit-GuidedQuant-LNQ
Updated • 9 -
jusjinuk/Qwen3-32B-4bit-GuidedQuant-LNQ
Updated • 7 -
jusjinuk/Llama-3.3-70B-Instruct-2bit-GuidedQuant-LNQ
Updated -
jusjinuk/Llama-3.3-70B-Instruct-3bit-GuidedQuant-LNQ
Updated • 1 -
jusjinuk/Llama-3.3-70B-Instruct-4bit-GuidedQuant-LNQ
Updated -
jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-LNQ
Updated • 13 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-LNQ
Updated • 46 -
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-LNQ
Updated • 15 -
GuidedQuant: Large Language Model Quantization via Exploiting End Loss Guidance
Paper • 2505.07004 • Published • 7 -
jusjinuk/gemma-3-27b-it-2bit-SqueezeLLM
Updated • 1 -
jusjinuk/gemma-3-27b-it-3bit-SqueezeLLM
Updated • 21 -
jusjinuk/gemma-3-27b-it-4bit-SqueezeLLM
Updated -
jusjinuk/Qwen3-32B-2bit-SqueezeLLM
Updated • 1 -
jusjinuk/Qwen3-32B-3bit-SqueezeLLM
Updated • 1 -
jusjinuk/Qwen3-32B-4bit-SqueezeLLM
Updated -
jusjinuk/Llama-3.3-70B-Instruct-2bit-SqueezeLLM
Updated -
jusjinuk/Llama-3.3-70B-Instruct-3bit-SqueezeLLM
Updated -
jusjinuk/Llama-3.3-70B-Instruct-4bit-SqueezeLLM
Updated -
jusjinuk/Llama-3.1-8B-Instruct-2bit-SqueezeLLM
Updated • 1 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-SqueezeLLM
Updated -
jusjinuk/Llama-3.1-8B-Instruct-4bit-SqueezeLLM
Updated -
jusjinuk/Llama-3.1-8B-Instruct-2bit-GuidedQuant-QTIP
2B • Updated • 1 -
jusjinuk/Llama-3.1-8B-Instruct-3bit-GuidedQuant-QTIP
2B • Updated -
jusjinuk/Llama-3.1-8B-Instruct-4bit-GuidedQuant-QTIP
3B • Updated • 5 -
jusjinuk/Llama-3.2-1B-Instruct-2bit-GuidedQuant-QTIP
0.4B • Updated -
jusjinuk/Llama-3.2-1B-Instruct-3bit-GuidedQuant-QTIP
0.4B • Updated -
jusjinuk/Llama-3.2-1B-Instruct-4bit-GuidedQuant-QTIP
0.5B • Updated -
jusjinuk/Llama-3.2-3B-Instruct-2bit-GuidedQuant-QTIP
0.7B • Updated -
jusjinuk/Llama-3.2-3B-Instruct-3bit-GuidedQuant-QTIP
0.9B • Updated • 2 -
jusjinuk/Llama-3.2-3B-Instruct-4bit-GuidedQuant-QTIP
1B • Updated -
jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP-skip_0_v
11B • Updated -
jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP-skip_0_v
Updated -
jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP-skip_0_v
19B • Updated -
jusjinuk/Llama-3.1-70B-Instruct-2bit-GuidedQuant-QTIP
11B • Updated • 1 -
jusjinuk/Llama-3.1-70B-Instruct-3bit-GuidedQuant-QTIP
15B • Updated • 1 -
jusjinuk/Llama-3.1-70B-Instruct-4bit-GuidedQuant-QTIP
19B • Updated