rastabastamon
/

qwen-2.5-7b-gptq-4bit

4-bit precision

Model card Files Files and versions

qwen-2.5-7b-gptq-4bit

5.58 GB

1 contributor

History: 2 commits

rastabastamon's picture

Upload 4-bit GPTQ quantized Qwen 2.5 7B model

26835e2 verified 6 months ago

.gitattributes

1.52 kB

initial commit 6 months ago
config.json

268 kB

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 6 months ago
generation_config.json

117 Bytes

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 6 months ago
model-00001-of-00002.safetensors

4.49 GB
xet

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 6 months ago
model-00002-of-00002.safetensors

1.09 GB
xet

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 6 months ago
model.safetensors.index.json

84.1 kB

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 6 months ago