prithivMLmods
/

Qwen3-VL-32B-Instruct-abliterated-v1

Image-Text-to-Text

text-generation-inference

Model card Files Files and versions

May I kindly ask if you are considering launching an FP8 version?

#2

by jtyy111 - opened 24 days ago

jtyy111

24 days ago

Similar to the official FP8 version, which would allow my local vLLM to run?

Owner 24 days ago

@jtyy111
Will do FP8 as well soon. 👍

jtyy111

23 days ago

thanks a lot!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment