iMatrix GGUFs for https://huggingface.co/Undi95/MG-FinalMix-72B

imat generated with Kalomaxe's groups_merged.txt

Downloads last month
124
GGUF
Model size
73B params
Architecture
qwen2
Hardware compatibility
Log In to view the estimation

We're not able to determine the quantization variants.

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MarsupialAI/MG-FinalMix-72B_iMatrix_GGUF