Qwen
/

Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text

8-bit precision

Model card Files Files and versions

Resources

View closed (1)

how to create the gptq model using GPTQModel package?

#4 opened 4 months ago by

使用时出现“probability tensor contains either `inf`, `nan` or element < 0” 错误

#3 opened 11 months ago by

Docker Image of Quantized Model

#2 opened 12 months ago by