you are viewing a single comment's thread
view the rest of the comments
[–] 18 points 8 months ago (3 children)

It's not that I've never tried it, I've dabbled in it consistently over the last few years. If you had said there was a major difference compared to 2 years or maybe even a year ago, sure. In the last 4 months, I guess we've gotten stuff like Claude 4.6, which saw an increase in coding performance by 2.5% according to SWE benchmarks. An improvement, sure, but certainly not an exponential one and not one which will fix the fundamental weaknesses of AI coding. Maybe I'm out of the loop though, so I'm curious, what are those exponential improvements you've seen over the last 4 months? Any concrete models or tools?

  • source
  • parent
  • hideshow 3 child comments
  • [–] 1 point 8 months ago

    I only ever started using and evaluating LLM agents this past December, but in my experience it kinda works now. I can't ascertain exactly why and how, but I was taken away how a simple prompt could get workable results.

  • source
  • parent
  • [+] [S] -17 points 8 months ago (1 child)
  • [–] 9 points 8 months ago* (last edited 8 months ago)

    I think you're mistaking improvements in tooling as improvements in the LLMs. LLMs are plateauing. The idea of exponential growth is an illusion. We took 20+ year old technology, geared it toward text (the LLM), and trained it on the entire Internet. Then, it's popularity grew exponentially.

    This is the hype narrative that Altman, Dario, Jensen, etc. push. They are trying to convince everyone that what we have is the Model T Ford of AI. Just imagine where we'll be in 6 months!

  • source
  • parent