Just buy an extra GPU and figure out how to turn it's VRAM into regular RAM. 😌

GPU prices are coming to earth

https://lemmy.today/post/42588975

Nvidia reportedly no longer supplying VRAM to its GPU board partners in response to memory crunch — rumor claims vendors will only get the die, forced to source memory on their own

If that's true, I doubt that they're going to be coming to earth for long.

Guess what, GPU prices are about to go back up because they rely on RAM.

Where are gpu prices coming down? 5070ti is what 800? 3090 24gb is 800-900 still. They not coming down anytime soon.

Not for long, GPU partners will have to source their own VRAM for manufacturing Nvidia now.

... I was thinking about buying a 96GB DDR5 kit from the local computer store a few weeks ago, but wasn't sure it was actually worth €700. Checked again now and the exact same product costs €1500. I guess that settles it, 32GB will have to be enough for the next couple of years then.

So.... the models are all trained up and now they need to run them is what I'm reading.

You need lots of vram to train a model.

An llm once trained can be run in much less vram and a lot of ram

This is very unfortunate, about a year ago I built my PC and only put in 32 GB of Ram, It was double I had on my laptop so I thought it should be enough for the beginning and I could buy more later.

Already after 2 months I realizes I can do so much more because of the fast CPU in parallel but suddenly the amount of RAM became the bottleneck. When I looked at the RAM prices it didn't seem quite worth it and I waited. But that backfired because since then the prices never went down, only up.

Buying used RAM on marketplace and hoping it isn’t broken. Hoping it was just stolen from a Best Buy. Fingers crossed y’all!

Prebuilts have become about the only way to get a deal for a while now.

Well that settles my idea of entertaining AM5.

Jam it right in my ass!

I just bought an Arc A310 for <$200. I couldn't find a set of 16x2 DDR4 in stock for less than that on Black Friday... Wild times for the RAM market.

You can finally get an RX 9070 (non XT), for under $600 MSRP now.

NewEgg has the ASRock 9070 at $530 right now.

You can even find 9070 XTs at $600.

The next closest GPU from Nvidia in terms of performance per $ is the RTX 5060.

Which is about half as performant as a normal 9070.

The Nvidia 5070 TI is a bit more performant than a 9070, a bit less than a 9070 XT... and its at $750.

https://bestvaluegpu.com/

It would be extremely wild if a techtuber did a 'lets revisit price per performance' for GPUs right now.

Of course I just bought a 970 xt for a lot a month ago, I did buy RAM before it shot up tho so thats nice. Slowly building a new PC thats not jank on Linux.

4080 still very pricey nearing $2k and the 5-series is even worse. 3080’s are in the $500+ range, so that’s decent.

GPU prices coming down are an indicator of the overall market sentiment around buying and building PCs with parts.

5090 are still not anywhere at MSRP though reliably. Seems like 2800 is the lowest on a shelf near me. 9070xt comfortably under 600 now though.

Memory prices are hitting the news everywhere but even at 200% or 300% of normal price you're still saving money over buying a gaming GPU in the first 6 months of the year when GPUs were chronically sold out. 16GB is kind of tight but 32gb is only $250 for 2x16gb @ 6000mhz CL30 at microcenter right near me. If this is "200-300%" pricing then I don't see what the big deal is.

News outlets have pointed the finger at "AI" rollouts, but we're several years in to AI rollouts and although HBM memory used in AI cards has had elevated prices, it hasn't affected desktop memory very much until the last couple of months. I suspect pre-emptive hoarding by commercial system builders is more to blame as companies like lenovo have mentioned having 150%+ of normal part inventory levels. Buy and hoard has been a key strategy to handling taco tariffs too for all kinds of nonperishable products all year long.