mistral-3.2-24b-gguf

mistral-3.2-24b-gguf is a GGUF Q4_K_M quantized version of mistral-3.2-24b, which is a 24B general purpose chat/instruct model from Mistral.

Model Description

  • Developed by: mistralai
  • Quantized by: llmware
  • Model type: mistral-3.2-24b
  • Parameters: 24 billion
  • Model Parent: mistralai/Mistral-Small-3.2-24B-Instruct-2506
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: General use
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
205
GGUF
Model size
23.6B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for llmware/mistral-3.2-24b-gguf