Hardware Requirements
#9
by
shreyas0985
- opened
Hi, I am trying to run this in a 2xh100 each with 8GPUs. I was wondering if anyone has been able to get this to work with vLLM and best practices for memory management and node-to-node communication.