all 11 comments

sorted by: hot top controversial new old
[–] 35 points 1 month ago (3 children)

ok bear with me, since I have dyscalculia and don't get these things easily:
does the whole diagram say: "over time the model numbers change" and that's it?

  • source
  • hideshow 3 child comments
  • [–] 34 points 1 month ago (2 children)

    Yes, it's the height is based on the vendor's model number they chose themselves at that time

    So if I released some shitty Super Smarto 2000.2 tomorrow, I'd be in the lead

  • source
  • parent
  • hideshow 2 child comments
  • [–] 22 points 1 month ago

    Joke's on them, I'm almost done training FaceBot 9000.

    Granted, it's a 1.2B model and the training data is entirely My Little Pony fanfics. It's insane and thinks it's Princess Luna. But it's going to dominate this benchmark.

  • source
  • [–] 12 points 1 month ago
    [–] 11 points 1 month ago

    Number goes up, can't argue with that!

  • source
  • [–] 9 points 1 month ago

    Graph is wrong, GPT is clearly using negative numbers

  • source
  • [–] 3 points 1 month ago*

    We don't want to lose the number war, but we didn't start it^TM^

  • source
  • [–] 1 point 1 month ago

    Gotta look past the bad charting - GPT's line is just going lower and lower with each release.

  • source
  • Even taking the chart at face value Anthropic looks on pace to catch up

  • source