qwen3-8b-instruct-gguf

qwen3-8b-instruct-gguf is a GGUF Q4_K_M int4 quantized version of Qwen3-8B, providing a very fast inference implementation, optimized for AI PCs.

Model Description

  • Developed by: Qwen
  • Model type: qwen3
  • Parameters: 8 billion
  • Model Parent: Qwen/Qwen3-8B
  • Language(s) (NLP): English
  • License: Apache 2.0
  • Uses: Chat, general-purpose LLM
  • Quantization: int4

Model Card Contact

llmware on github

llmware on hf

llmware website

Downloads last month
8
GGUF
Model size
8.19B params
Architecture
qwen3
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support