you are viewing a single comment's thread
view the rest of the comments
[–] 10 points 3 months ago (4 children)

It seems to have been a plan for a long time, given their huge shift to unified memory architectures across most of their hardware.

They’re pretty much the only vendor where you can cost-effectively deploy a foundational LLM locally.

  • source
  • hideshow 4 child comments
  • [–] [S] 4 points 3 months ago (2 children)

    It would seem so. On the other hand, it is puzzling that they did not also allocate the necessary resources to the development of LLMs. 🤷

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 3 months ago

    Still nobody build a unified memory model with HBM. I would buy Apple hardware, then. If I can put Linux on it.

    Perhaps I can buy a used Instict with generics science acceleration, once the smoke clears. And add a couple solar kWp to my capacity.

  • source
  • parent