Can anyone confirm?
you are viewing a single comment's thread
view the rest of the comments
[–] 51 points 1 year ago (2 children)

There was a paper about this not long ago. The problem is, how LLMs get trained: a right answer gets a point, everything else gets no points. This rewards guessing (produces a point sometimes) over answering "I don't know/I can't do this" (produces never a point)

  • source
  • hideshow 2 child comments