There is no shortage, the ram is being hoarded by ai bros
post
Isn't there a 4rth RAM producer in China that is starting to make waves?
Honest question, why would the prices at this point ever go down again, even if the AI bubble pops?
Those companies are now used to these profits. For them, profits always have to increase year after year. If there's no other choice of vendor (and I know this would open an opportunity for a new vendor to come and be cheaper, but if it were that easy with RAM it would have happened already), why would they even care to reduce it again?
The price is due to AI companies paying for the RAM at high prices. When the demand goes down the price should naturally come down, same thing happened with GPUs with crypto mining.
Don't forget that Chinese companies also started making DDR5 RAM, if they can increase their output and keep up with demand, I believe the price will go down. Maybe in the future Chinese companies will dominate the RAM industry.
Pay attention to history. Supply crunches like this are followed by supply glut.
There's a reason why a company like SanDisk is signing multi year fixed price contracts now with the big data guys. That's not a bet on hardware prices continuing to rise.
Yeah this is like when the cops investigated themselves and find no wrongdoing. Why would anyone listen to the chip mafia when they have only their own interests in mind. They want you to think that there is no point in waiting for prices to drop, when that is obviously what everyone should be doing right now. Basically everyone should boycott the entire semiconductor industry as much as possible.
Unavoidably high prices are unavoidable says company who's actions are causing prices to be high
Yeah. Sure.
Bullshit. Chinese RAM is ramping up to world scale levels. LLMs are reaching massive diminishing returns points, and open weights local AI setups that are near frontier level, and which can be run on consumer level hardware are already here, and getting very hardware efficient. The AI bubble burst is very close. Memory makers are pushing FOMO buying.
Yea, I wouldn’t be surprised if Samsung and SK Hynix would come to regret their deals with OpenAI once the Chinese have ramped up production and price them out of the market.
This. As with any technology, it will always improve. The American government helped the Chinese by barring the chips from them, meaning they had to program more efficient models.
We don't know if they're actually more efficient because ClosedAI and Anthropic won't tell us how (in)efficient their models are, whether they're running quants, etc. Kimi K3 is about 3 terabytes of VRAM unquantized so I wouldn't call the Chinese models super efficient either. The "efficient" models are the distillations and particularly quantized versions of some Chinese models. Nothing stopping ClosedAI and Anthropic from doing the same if they're willing to lose a bit in accuracy.
The local models require massive amounts of ram that isn't available for most consumer hardware
I do hope the bubble bursts soon but low ram and local ai aren't compatible
Ay, if you are sure about that, buy calls (or puts, idk) from open AI and 2x your money!
SK Hynix has strong incentives to say this. It's an unremarkable statement.
I really, really hope that the Chinese take most of the market away from these assholes.
Sure, as long as you don't account for the AI bubble ever bursting. After that, memory will be cheap. We'll be living in an economic hellscape, but the memory will be cheap.
why would it be cheap, if people would buy it at 4x the normal price?
The price is only high because of the artificial demand from all the data centers. Manufacturers are increasing production capacity to provide more supply. Once the bubble bursts, that demand will drop, but the production capacity will still be there. Supply and demand. Price will go down.
thats what the economics textbook says, but it also says that all parties in the economy are perfectly rational. however this is not the reality. they have tested it, people are already used to the high prices and they have no problem with it, enough of them will buy it anyway. the price drops from completely unaffordable 7x price to barely affordable 4x price, and people are already buying it again. if they aim for 4x price, they only need the quarter of the former sales to make the same profit. and if at 4x price the sales are the quarter of former sales, they could theoretically shut down most factories or production lines to reduce costs and in turn raise profits even more.
I thought of the problem is they aren't ramping up production because they think AI is a bubble
First new fabs are being opened this or next year last I heard. AI boom started in 2022 and fab construction and setup time is said to be 4 years (or more if there are issues).
Of course the question is, will they be making more DDR or more HBM...
No, they are definitely ramping up production, just not nearly fast enough. Chip factories take longer to build than data centers.
That's a pretty naive assumption to make.
I made four different assumptions which one did you think was naive?
I don’t like conspiracy theories but hugging face was bought, tens of thousands of Mac’s were bought, RAM is “indefinitely “ high priced.
Starting to feel someone doesn’t want the self hosted AI to get legs.
It's just hyper capitalism unfortunately.
Self hosting isnt a threat to them, most folks ain't doing that. And those of us who do already block most of their ways to generate revenue of our usage, so we don't really matter to them.
Self hosting also requires a ton of RAM because each individual user has to load a (usually slightly smaller) model + KV cache, whereas for hosted, they load the huge-ass model once (per cluster) and then store KV caches for a bunch of users, which has better scaling.
The memory companies win whether you self-host or pay a subscription. They might win more if you self-host because look at the cost of self-hosting, it's actually pretty steep if you don't have the hardware already from the before times.
Could it be again due to price fixing agreements. It's a real cartel!
No, it's because they switched their manufacturing to chips used in AI datacenters, which aren't the same as what is in consumer hardware.
The price fixing agreements will happen after the bubble pops, assuming the demand actually drops.
My prediction is that the intent is to kill the consumer hardware market so we have to subscribe to a virtual desktop.
Well both. Yes they also switched manufacturing to HBM memory. And it's still a cartel.
and we're screwed... who's to say china won't end up rationing their own new-found capacity? enough for the domestic market, perhaps that of a few small important allies.. and then put the rest into their own data centers. the global market is only gonna get what they don't need or want themselves.
Help us, China. You're our only hope.
Goddammit this is so infuriating as a homelabber
Company that has a vested interest in keeping prices high says prices will remain high. Yeah, I'm not going to trust that source.
You should though.
Not only do they have an interest, they are also in control of that price. And any other supplier is exactly in the same boat. When supply is lower than demand, prices go up, it's economics 101.
Except both CXMT is ramping up and at the same time datacenters buildouts are slowing. Supply is going up and demand is dropping. It's economics 101.
I bet it's not going to be that indefinite, a year tops before CXMT ramps up RAM production https://www.reuters.com/world/asia-pacific/chinas-cxmt-makes-breakthrough-advanced-memory-chips-information-reports-2026-08-31/
On one hand it is an opportunity for CXMT to gain more market share. On the other when demand drops they will be left with excess capacity and that might discourage them from expanding.
It's bad, OK, I'm not trying to remove any blame or criticism for the situation.
That being said, what actual normal usage for a normal person (not a National Geographic 8K stereo 360 video editor or a developer compiling Firefox daily) needs a lot, say more than 16GB, of RAM?
Again I'm not trying to find a way to accept a bad situation, only to see which actual usages are in trouble because honestly I don't see any.
There are some games that require a lot of RAM, especially if recording while playing or something.
The fact that you wrote "some" perfectly illustrates my point, it's not normal. It doesn't mean those usages aren't important, just not typical.
It just means I wasn't sure my example (4x games) was completely right
Did a quick search and "Most games required more than 16GB RAM ONLY if the game was played at 4k or 8k resolution. Usually between 16-25GB RAM" https://laptopstudy.com/ram-usage-games/ so I would argue that's not a typical usage.
Hosting an accurate AI locally typically takes 24GB of VRAM. Not having sufficient VRAM makes you reliant on remote models as a paid service. You pay many more times for tokens what you could pay for RAM just once for limitless tokens.
Same, that's not a normal usage. Spending a lot of time on Lemmy/Reddit/HackerNews tech community might lead to believe running a local model is normal but very few people do. When they do it's typically on GPUs or Mac precisely for their unified memory architecture... but it's not a normal setup even for gamers. Also typically it's to tinker locally and learn from than actually productivity. I'm repeating here, I'm not saying it's not an interesting use case for some, just not what most people do.
Implicit in this prediction, is the assumption that AI data-center demand will continue that long.
Even if the AI bubble burst today and we canceled all data center plans, it would take a while to pivot production back to something useable for consumers instead of highly specialized servers. Not four years but at least a couple of months.
A lot of startups are using at least partially consumer grade hardware, which will likely get offloaded to the used market when the bubble bursts as they try to recoup some of their losses. This will put some pressure on pricing especially for used parts.
I don't think it'll put pricing back at pre-AI levels immediately, but it will likely cause prices to start to drop pretty soon after the bubble bursts, even before manufacturing is able to change focus.
It alao assumes that each data center will have a hardware refresh every few years to sustain demand.
I can't see demand surviving the necessary pricing to be profitable over time with the inital hardware, much less to pay for the inevitable refresh.
Of course. The predictions were that they'd remain high until 2030, not that they'd go down after that.
It’s gonna be pretty funny when the bubble bursts and the memory and GPU companies that fucked over their bread-and-butter consumers, have to come groveling back to us in order to prop up their companies once again. I’m so goddamn sick of tech I might try to ride it out with my 2019 laptop for the foreseeable future. If a game doesn’t run on it, it will just become a game I don’t play.
You don’t think their main source of income was ever consumer-grade memory… do you?
It’s always been servers and business customers.
I think SK Hynix's projection is incredibly naive. I'd be surprised if by 2028 the Chinese haven't captured this market yet, inevitably impacting prices.
You don't have to be an oracle to expect this, it is a fact that CXMT is already scaling up consumer DDR5 production. Yes they are behind in technology, but home users won't care much as long as they can put them into their DDR5 mobos & run them in dual channel..
Anyway my prediction is that 2 years from now the prices will be significantly down, but still high compared the business as usual & the moment the bubble pops -if it does & not before 2029- prices will go down to what's normal or even below normal for the larger sticks.
On so sorry guys we have no idea how we could lower the prices that are making us rich. I mean we could increase the supply and work towards a new norm of what the market needs but that'll take at least a decade of high prices.
SK Hynix, who recently floated on the stock exchange, says thing to prevent line go down.
And now, the weather


all 14 comments