you are viewing a single comment's thread
view the rest of the comments
[–] 1 point 8 months ago* (1 child)

So from the inference / customer computation side of things, it isn’t a problem.

Not necessarily. There are inference schemes where spreading MoE models across 40+ GPUs with a fast interconnect yields better efficiency.

looks like blackwells can run sunstained at 88c

The coolant still needs to remain relatively cool to hold that silicon temperature, though. Practically it can't be like 60C.

  • source
  • parent
  • hideshow 1 child comment