146
According to this news story, AI is subtly making devices more expensive. Who would have guessed? Everyone! ๐Ÿ™„ (www.thedailyupside.com)
submitted 3 months ago by to c/fuck_ai@lemmy.world
16 comments fedilink hide all child comments

all 19 comments

sorted by: hot top controversial new old
[โ€“] 43 points 3 months ago (3 children)

subtly

  • permalink
  • fedilink
  • source
  • hideshow 3 child comments
    •
    • [+] 22 points 3 months ago (12 children)
    [removed by mod]
  • permalink
  • fedilink
  • source
  • hideshow 12 child comments
    •
  • [โ€“] 15 points 3 months ago (3 children)

    It's here to stay, the US is literally using it for pre crime policing. It's permanent and a far bigger deal than anybody realizes.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [โ€“] 4 points 3 months ago

    The detection models used for surveillance use less energy, and centralization means "one big customer". It won't play out so neatly for the fascists. Of course, the tech bro capital wants to be part of the MIC where they get corporate welfare (socialism for the rich.)

  • permalink
  • fedilink
  • source
  • parent
  • [+] 3 points 3 months ago (2 children)
    [removed by mod]
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [โ€“] 2 points 3 months ago (1 child)

    Get some reading comprehension, I'm not hyping this shit up. It does not matter how high the rate of wrong info, hallucinations, or wrongful arrests, the corps and governments will never give that power up. The world HAS changed. This is nothing like crypto and it is already applied.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
    • load more comments (-1 replies)
    • load more comments (-1 replies)
  • [โ€“] 4 points 3 months ago*

    HBM memory can technically be used by consumer GPUs. In 2015, AMD released the Radeon R9 Fury X which used HBM. When the bubble pops and there's an extreme oversupply of HBM sitting in warehouses, we will get those types of GPUs back.

    And even if the big players decide not to do it, crazy people in China will build their own products and adapters, they will even desolder HBM from worthless datacentre GPUs.

    Either way, it's gonna be glorious for us all. Let's just hold on for a while longer, until all of the dominos have fallen.

  • permalink
  • fedilink
  • source
  • parent
  • [โ€“] 2 points 3 months ago (4 children)

    Nah. If there really is a crash and a sudden glut of AI GPUs and related hardware, it'll drop the prices of everything PC-related real fast.

    The hardware will absolutely, 100% continue to be used for AI stuff. Nobody is going to buy that stuff in bulk just to start desoldering chips. That would be stupid, because...

    The demand for AI is just too damned high! If anyone can bid on OpenAI's bankruptcy hardware sale, either one BIG player is going to take it all (read: Microsoft... Which was the plan all along I swear!) or it'll be sold in batches and loads of small AI companies (including startups) will get it cheap.

    Small companies are already reselling tokens on their tiny little hardware farms using open models like GLM and Qwen. Anyone with the hardware can do so, and there's loads of money to be made doing it. So why would businesses bother trying to use that memory for anything else? They wouldn't.

    However, a huge sale will create a glut regardless, which will almost immediately drop prices by some huge amount. The demand will slowly go back upโ€”because AI demand is still growingโ€”but we'll all get relief for probably six months to a year.

    Listen to me: If that happens, that is when you want to buy a new GPU/PC! Wait like 2-3 months after OpenAI's bankruptcy announcement (save that money), then spend it on the best hardware you can get. Because the demand for AI isn't going anywhere. It's just going to drop back down into reality: Where they only build data centers where it makes sense. As in, where there's actually plenty of power available (or they can just install a zillion solar panels).

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [โ€“] 1 point 3 months ago*

    The hardware will absolutely, 100% continue to be used for AI stuff. Nobody is going to buy that stuff in bulk just to start desoldering chips. That would be stupid, becauseโ€ฆ

    the GPU units are huge and made for data center racks, you won't get to "plug and play" one in a PC, even if you can afford it.

  • permalink
  • fedilink
  • source
  • parent
  • [โ€“] 1 point 3 months ago* (2 children)

    because AI demand is still growing

    Is it, though? Most of OpenAIs customers are free users and outside of the coding sphere there isn't a major usecase for LLMs. When the bubble pops and people will have to pay a lot more for their token usage, a lot of them will just turn away. The free users will never convert to a paid model as well.

    Nobody is going to buy that stuff in bulk just to start desoldering chips.

    Don't underestimate Chinese vendors doing absolutely everything to turn a profit.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [โ€“] 1 point 3 months ago (1 child)

    It's the code generation and automation uses that are growing. I don't know about casual use or using AI for office tasks.

    AI providers that offer API access don't have enough hardware to support the demand. They keep increasing prices (the roundabout way by slowing down requests, reducing the amount of included tokens in tiers, and replacing models with new ones that use more tokens) and that's still not enough to reduce demand.

    Using AI to code and automate stuff is probably its most effective use. But most people don't see it. Is all business/enterprise stuff happening behind the scenes.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [โ€“] 1 point 3 months ago

    The hardware shortage is self-induced by the LLM providers, though - it doesn't reflect actual demand. They're shooting themselves in the foot by making their models bigger and throwing more and more data and compute (and energy and water) at it, for increasingly diminishing returns.

    In my opinion, that's not sustainable in the longterm and after the bubble pops, even the code generation ecosystem will change a lot. It's gonna be interesting to see which way of working will survive.

  • permalink
  • fedilink
  • source
  • parent
    • 1 comment in c/world@lemmy.world view that post
    [โ€“] 2 points 3 months ago

    Because AI has become so lucrative, the three major RAM manufacturers have shifted from mostly producing conventional DRAM to focusing more of their capacity on HBM, which is what AI data centers need.

    The author probably wants "DIMMs" rather than "DRAM". HBM memory is DRAM too (well, I guess theoretically you could make non-DRAM memory with an HBM interface, but...)

  • permalink
  • fedilink
  • source
    •