can you show a comparision image

#3
by ZKong - opened

i don't think q2k is worth a try

Sadly, not everyone can run even 3-bit quants of the models

image
What should I do if an error message pops up during execution?

@windblow001024 What's the backend version? What's the GGUF node?

actually q2 is quite amazing and works well

image
What should I do if an error message pops up during execution?

update your node to the latest version then it should work

Sign up or log in to comment