For one month beginning on October 5, I ran an experiment: Every day, I asked ChatGPT 5 (more precisely, its "Extended Thinking" version) to find an error in "Today's featured article". In 28 of these 31 featured articles (90%), ChatGPT identified what I considered a valid error, often several. I have so far corrected 35 such errors.

you are viewing a single comment's thread
view the rest of the comments
[+] 66 points 11 months ago* (1 child)
  • [–] 2 points 11 months ago

    But we don't know what the false positive rate is either? How many submissions were blocked that shouldn't have been, it seems like you don't have a way to even find that metric out unless somebody complained about it.

  • source
  • parent