you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 6 months ago (2 children)

Models can split loads across a discrete GPU and CPU/RAM.

Its not as fast as if you can load it all in the GPU, but it gives you more options. Its been quite common for a long time.

  • source
  • parent
  • hideshow 2 child comments