rastabastamon
/

qwen-2.5-7b-gptq-4bit

4-bit precision

Model card Files Files and versions Community

qwen-2.5-7b-gptq-4bit

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

rastabastamon's picture

Upload 4-bit GPTQ quantized Qwen 2.5 7B model

26835e2 verified 3 months ago

.gitattributes

1.52 kB

initial commit 3 months ago
config.json

268 kB

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 3 months ago
generation_config.json

117 Bytes

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 3 months ago
model-00001-of-00002.safetensors

4.49 GB
LFS

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 3 months ago
model-00002-of-00002.safetensors

1.09 GB
LFS

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 3 months ago
model.safetensors.index.json

84.1 kB

Upload 4-bit GPTQ quantized Qwen 2.5 7B model 3 months ago