vllm import error

#32
by xkzhang - opened

Hi,

I install the vllm environment following the instructions. It is installed successfully. But when I try to launch the server by "vllm serve /mnt/cfs/NLP/hub_models/Voxtral/Voxtral-Mini-3B-2507/ --tokenizer_mode mistral --config_format mistral --load_format mistral", it outputs the following errors "from transformers import BatchFeature, PretrainedConfig, ProcessorMixin
ImportError: cannot import name 'ProcessorMixin' from 'transformers' (/mnt/cfs/SPEECH/zhangxinke1/tools/env/miniconda3/envs/s2s/lib/python3.9/site-packages/transformers/init.py)"

Thanks in advance.

Sign up or log in to comment