56
Shouldn't we urgently define metrics that will allow future people to track the impact of LLMs on human cognitive abilities over time? (lemmy.world)
submitted 3 months ago by to c/asklemmy@lemmy.world
19 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 15 points 3 months ago (1 child)

See Goodhart's law: “When a measure becomes a target, it ceases to be a good measure”.

If LLMs are judged by some specific metric meant to track their negative impact, they’ll adapt to make the metric look good without improving the underlying impact.

  • permalink
  • fedilink
  • source
  • hideshow 1 child comment
    •
  • [–] 7 points 3 months ago

    Great example of Goodhart:

    I used to work at a Verizon store, and we were rated by the amount of accessories we could sell with each phone. In order to boost that number, everyone tried to add on a bunch of cheap phone accessories (clearance items and screen protectors) to drive that number up.

    Our goal was more than three, but once we figured out how to sell 5 or more for less than $20, they changed it to total cost of accessories per phone.

  • permalink
  • fedilink
  • source
  • parent