you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 12 hours ago

I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.

  • source
  • parent