AttributeError: 'MLACommonMetadataBuilder' object has no attribute 'page_size'
#6
by
Jerry-PigeonG
- opened
How to solve this probelm? I have try VLLM_FLASH_ATTN_VERSION=3, my vllm version is 0.8.5.post. I try to run this model in L20 (48GB) GPU, but failed.
This is a known issue in vllm. See https://github.com/vllm-project/vllm/issues/16908.
The solution if either downgrade your vllm version lower than 0.8.4 or upgrade to latest(0.9.2).
Thanks, 0.9,2 vllm solve this problem.
lsw825
changed discussion status to
closed