you are viewing a single comment's thread
view the rest of the comments
[–] [S] 2 points 2 weeks ago*

This is also like the reason why Nvidia markets the nvl72 rack as being able to train 10t parameter models, because closed ai companies already do it with 1 or two racks. Maybe 20t parameter models with 2 racks.

  • source