you are viewing a single comment's thread
view the rest of the comments
[–] 4 points 3 months ago

They're not instructed to, it's an inescapable artifact of their training.

Their training selects on completions that humans prefer, not completions that are most accurate. Sometimes accurate completions are what humans prefer, but the accuracy is not the goal, so accuracy in the completion is a happy accident.

  • source
  • parent