195
It really likes this phrase (lemmy.world)
submitted 3 months ago by to c/memes@lemmy.world
19 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[–] 3 points 3 months ago (4 children)

I heard something like OpenAI (or Anthropic?) tweaked one of their AI's to do well on a certain benchmark test and while they did have the highest score they couldn't publish the model because it used like $20,000 in electricity alone to make sure it's answer was correct.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 4 child comments
    •
  • [–] 4 points 3 months ago (3 children)

    The answer was probably something like:

    ".........Yes! You do need eggs to make an omelet!"

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 3 points 3 months ago (2 children)

    "You need to drive your car to the car wash."

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 5 points 3 months ago* (1 child)

    For context, this is a real question that stumped a lot of LLMs:

    "I want to wash my car. The car wash is 100 meters away. Should I walk or drive?"

    Of course it's famous now, so they have added specific exceptions for it (or just because it's famous they've scraped the solution)

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 3 points 3 months ago

    It is also a great example of how low people's expectations are of tech they have spent around a trillion dollars on to get something that is about as good as asking a random person.

    "People get the puzzle wrong!"

    We don't spend a trillion dollars for someone to fail a simple logic puzzle.

  • permalink
  • fedilink
  • source
  • parent