242
IBM CEO says there is 'no way' spending trillions on AI data centers will pay off at today's infrastructure costs (www.businessinsider.com)
submitted 11 months ago by to c/technology@beehaw.org
17 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 31 points 11 months ago* (last edited 11 months ago) (2 children)

LLMs are evolutionary dead ends. Very expensive ones at that.

Even the companies doing things where LLMs are actually good at, rely on companies like OpenAI so when OpenAI goes down so will they.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 11 months ago (1 child)

    The real issue and what those AI dependent companies are banking on is that they can capture a user base and when OpenAI starts to reach the end of the road with LLM improvements and moves to the extract phase it can buy these little companies to ingest their user base.

    Everyone else in that space will be instantly fucked since they will now be competing directly with openai while paying their margin but that's the bet they are making.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 11 months ago

    They're banking on diffusion eliminating the hallucination problem, but it's too onerous to run very, very large models with it yet. Auto regressive LLMs are a dead end. One that is far away. LLMs are not and we will continue to learn a lot about them as we continue to implement them. Anyone who thought we were at a dead end should use the new Gemini. It's like a GPT 3.5 to GPT 4 level of improvement.

  • permalink
  • fedilink
  • source
  • parent