adding vLLM deployment scripts

#1

Hello, congratulations on the launch and thanks for open sourcing models.

I was trying to run it with vLLM and came to this script. Let me know if there is any bugs!

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment