4
64 96 or 128gb ddr5 5600 sodimms for LLMs 780m igpu (lemmy.ca)
submitted 1 year ago by to c/minipcs@lemmy.world
1 comment fedilink hide all child comments
 

On desktops, I have seen problems (not direct experience) with getting full speed from 4x64gb ram sticks. Will 5600ddr 2x64gb sodims be stable on a budget (BOSGAME 7840hs) mini pc?

For use with LLMs, I doubt the 780m can have great (usable?) performance for models that would need 128gb (with context for coding). 96gb is decent price/size value. But is 64gb simply enough for what you would practically use?

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 1 point 1 year ago

specifically are 70b models at 8bit quant, usable at all on 780m?

  • permalink
  • fedilink
  • source
    •