807
Life of a PC gamer (lemmy.world)
submitted 1 year ago by to c/memes@lemmy.world
84 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 59 points 1 year ago (12 children)

I saw a random AI video where guy said to use this model you need 39gb of vram. Like wtf are these ppl running at home?

  • permalink
  • fedilink
  • source
  • hideshow 12 child comments
    •
  • [–] 36 points 1 year ago (1 child)

    39 GB is very small, DeepSeek R1 without quantization at full context size needs almost a full TB of RAM/VRAM.

    The large models are absolutely massive and you will still find some crazy homelabber that does it at home.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 12 points 1 year ago* (8 children)

    I put (regular RAM) 64gb on my home pc, because that was the max my board would take. My old Mac Pro, 96gb because it was the most it could run at max speed, total could have been 128. Both only for 8gb gfx cards. Both because, I might want to open 400 tabs on a browser or something, maybe casual gaming, lol

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 8 child comments
    •
  • [–] 29 points 1 year ago (7 children)

    They're talking about VRAM in a GPU, not motherboard RAM.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 7 child comments
    •
  • [–] 6 points 1 year ago (3 children)

    Mac has unified RAM. It can use the system RAM as vRAM. The AI line of AMD processors can kind of due that too. Granted these aren't as fast as dedicated GPUs, but they're the most affordable way to get huge amounts of vRAM.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 1 year ago (2 children)

    Are there any apple chips that use unified memory thats external? I’m like 99% sure chips with unified memory have it integrated on-die with no option for expansion.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 1 year ago

    The meme differentiates between shortage of GPUs and shortage of memory, so I thought it was about mobo ram, but I get that the comment I replied to mentioned vram.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 1 point 1 year ago*

    vram in the context of an igpu like an apple chip or strix halo is the same thing as system ram. its shared memory

    its why strix halo and apple m4 chips are popular with users running local ai models, because those will cost you 2-4000$ for 128 gb ram, while the closest nvidia alternative is the RTX 6000 blackwell with 96gb vram costing 2-4x more.

  • permalink
  • fedilink
  • source
  • parent