705
Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" (opper.ai)
submitted 8 months ago by to c/technology@lemmy.world
334 comments fedilink hide all child comments
 

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the 'reasoning' models.

you are viewing a single comment's thread
view the rest of the comments
[–] 0 points 8 months ago (1 child)

In fact it cannot ever be a useful way of extracting information. Even just randomly guessing is a better way to get the information you want than torture.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 1 point 8 months ago

    I'm not saying its anything other than morally repugnant, obviously, but in the example of a password with billions or trillions of combinations and where you can check the answers given torture pretty obviously is better than guessing.

    That's not a scenario that is ever likely to come up, and wouldn't be justifiable even if it did, but pretending it wouldnt be effective is ridiculous.

  • permalink
  • fedilink
  • source
  • parent