Kalothar comments on Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM

Serving GLM-5.3 at 607.8 tok/s across two Nvidia DGX stations with vLLM (developer.nvidia.com)

submitted 16 hours ago by rssbot@lemmy.bestiver.se [B] to c/hackernews@lemmy.bestiver.se

2 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] Kalothar@lemmy.ca 4 points 11 hours ago (1 child)

Ah yes, just need to get me two $85k work stations and bridge them together

hideshow 1 child comment

[–] ButtermilkBiscuit@feddit.nl 3 points 11 hours ago

Try $161k EACH

https://www.dell.com/en-us/shop/cty/spd/dellpromaxwithgb300fct6263

parent