I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.