adding vLLM deployment scripts
#1
by
murodbek
- opened
Hello, congratulations on the launch and thanks for open sourcing models.
I was trying to run it with vLLM and came to this script. Let me know if there is any bugs!