you are viewing a single comment's thread
view the rest of the comments
[–] 2 points 6 days ago

You don't use local LLMs the whole time your computer is on. Still, there is no such thing as "wasted RAM". The RAM programs aren't "using" is used by the OS as cache.

It is also possible to use VRAM as system RAM

  • source
  • parent