you are viewing a single comment's thread
view the rest of the comments
[–] 23 points 2 months ago (1 child)

Props for responding constructively.

The false positive rate is pretty low, but a false negative of 35% is pretty concerning in terms of whether they're fit for purpose. Like it'll rarely misclassify human writing as AI generated, but it's somewhat closer to a coin flip in correctly identifying AI generated language. It's a signal, but I imagine it's a poor substitute for the judgement of a person who has spent time teaching teenagers / young adults to write.

Which to the original point isn't totally snake oil, but it's maybe not a great tool for the professionals who it's targeting.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago* (last edited 2 months ago)

    The false negative rate for creative writing is exceedingly low as well, sub 1%. False negatives aren’t the critique of this meme, and the examples I gave for GPTZero were worst case scenarios for very specific types of technical writing.

  • source
  • parent