226
Mark Zuckerberg tells staff that AI agents haven’t progressed as quickly as he’d hoped (techcrunch.com)
submitted 4 months ago by to c/technology@lemmy.world
33 comments fedilink hide all child comments
🤣 1
you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 4 months ago (2 children)

The whole thing was based on ruthless extrapolation. LLM do better with more compute, so keep throwing compute at it until you're in free money land. The last hurrah for Silicon Valley as they're all out if ideas now.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 4 months ago (1 child)

    LLMs do better with more compute, but it's logarithmic.

    They raced up the soft part of the curve, thinking it was the start of an exponential.

    I think that's the core issue; they bet a trillion dollars expecting compounding returns, and got diminishing ones.

    If I were an employee/shareholder, I'd have been happy to hear the first part of his message ("oh good he finally gets it") and then miserable again when he says he does believe the singularity will happen, just in 3-6 months.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 4 months ago

    Yeah, that's the ruthless extrapolation. It's like plotting the air speed of planes from Wright brothers to Concorde, continue drawing the line going upward and conclude that by 2026 you'll go from Paris to New York in five minutes. It never works like that.

  • permalink
  • fedilink
  • source
  • parent