vllm推理32k-128k输入

#17

by luckyZhangHu - opened Mar 7

Mar 7

vllm推理，按默认的config.json中， max_position-embedding-128000, 是否能正常处理 32k-128k的长图文理解输入？

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment