Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 8 months ago

You said this puzzle "wasn't tricky in the slightest" and yet that "it requires understanding what is being asked."

Correct. Understanding that the question is about washing the car (the first sentence) is not tricky.

So only 71.5% of humans can accomplish this "not tricky in the slightest" problem

30% of people are fucking idiots. This keeps being proven. My argument is in no way changed by this fact.

Is "understanding" things not "tricky"?

No. Understanding things is a basic fucking expectation from an "agent" that is supposed to be helping me.

  • source
  • parent