-8
Is the AI hype still on or have the models plateaued? (optimizedbyotto.com)
submitted 8 months ago by to c/technology@lemmy.world
17 comments fedilink hide all child comments
 

I tested 9 flagships (Claude 4.6, GPT-5.2, Gemini 3.1 Pro, Kimi K2.5, etc.) in my own mini-benchmark with novel tasks, web search disabled and zero training contamination and no cheating possible.

TL;DR: Claude 4.6 is currently the best reasoning model, GPT-5.2 is overrated, and open-source is catching up fast, in particular Moonshot.ai's Kimi K2.5 seems very capable.

you are viewing a single comment's thread
view the rest of the comments
[–] [S] 0 points 8 months ago

Actually I set out with the assumption that flagship models would fail even on these fairly simple questions that I have seen them failing on before, but I was suprised they didn't all fail.

  • permalink
  • fedilink
  • source
  • parent