all 63 comments

sorted by: hot top controversial new old
[–] 68 points 2 months ago (11 children)

It's really just that AI detectors are snake oil

  • source
  • hideshow 11 child comments
  • [+] -33 points 2 months ago* (last edited 2 months ago) (10 children)

    They’re not. GPTZero has a false positive rate under 1% for creative writing.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 37 points 2 months ago (6 children)

    That’s a bold claim with no proof.

  • source
  • parent
  • hideshow 6 child comments
  • [–] 22 points 2 months ago* (last edited 2 months ago) (5 children)

    Worst performance for GPTZero is technical medical papers with a 10% false positive rate. Here’s the study from S. Korea.

    Scientific scholarly writing: <4% false positive.

    Creative writing is orders of magnitude easier to detect. The biggest problem for AI writing detection tools is the use of translation — so generating text, translating it into another language, and translating it back — but this ends up as a false-negative issue. False positives are very rare.

    More importantly, we don’t need GPTZero to detect AI writing because professionals can identify it on sight. Add context clues (students are dumb) and suddenly it’s trivial.

    EDIT: I need you to understand that college students are terrible writers. In all my decades and literally thousands of students, I’ve met maybe three undergrads whose writing was more than proficient, and that's in an Ivy League environment. The idea I’m going to mistake your writing for AI (which sounds horrible and robotic, btw) because of its “high quality” is simply unfathomable.

  • source
  • parent
  • hideshow 5 child comments
  • [–] 23 points 2 months ago (1 child)

    Props for responding constructively.

    The false positive rate is pretty low, but a false negative of 35% is pretty concerning in terms of whether they're fit for purpose. Like it'll rarely misclassify human writing as AI generated, but it's somewhat closer to a coin flip in correctly identifying AI generated language. It's a signal, but I imagine it's a poor substitute for the judgement of a person who has spent time teaching teenagers / young adults to write.

    Which to the original point isn't totally snake oil, but it's maybe not a great tool for the professionals who it's targeting.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago* (last edited 2 months ago)

    The false negative rate for creative writing is exceedingly low as well, sub 1%. False negatives aren’t the critique of this meme, and the examples I gave for GPTZero were worst case scenarios for very specific types of technical writing.

  • source
  • parent
  • [–] 4 points 2 months ago (2 children)

    Thank you for linking me to that study! Unfortunately google is a piece of shit and they’re calling me a bot and refusing to talk to me even though I’m on a standard residential internet connection. Could you tell me the title/authors so I can look for it elsewhere?

    I’m particularly interested in seeing what the actual false positive rates are beyond a colloquial “1%”. Because 1% is, in the context of accusing academic cheating, absolutely unacceptable dog shit.

    Take a basic example intro class with 350 students, with only two tests per semester. With “only” a 1% false positive rates you will be destroying the lives of more than a dozen innocent kids every school year. And thats only for one class, students are taking many classes per semester.

  • source
  • parent
  • hideshow 2 child comments
  • [+] -2 points 2 months ago* (last edited 2 months ago) (2 children)
  • [–] 1 point 2 months ago (1 child)

    I’m glad I never had you as a professor, your overconfident arrogance is terrifying.

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
  • load more comments (-1 replies)
  • [+] 3 points 2 months ago* (last edited 2 months ago) (3 children)
  • [–] 6 points 2 months ago (2 children)

    It's literally from a Chick Tract. It's an ancient meme... circulating for the past 10 years or so.

    KYM

    Whether the person posting it is right or wrong, it's not really an endorsement of religion. It's like "scapegoat", or "omg".

  • source
  • parent
  • hideshow 2 child comments
  • [+] 0 points 2 months ago* (last edited 2 months ago) (2 children)
  • load more comments (-1 replies)
  • load more comments (-1 replies)
  • [–] 20 points 2 months ago (1 child)

    Seeing artists and animators who have been doing their thing long before AI getting demonitized or deleted with accusations of using AI to generate their work is really starting to piss me the fuck off.

  • source
  • hideshow 1 child comment
  • [–] 19 points 2 months ago (3 children)

    I’ve gotten this a lot. I was also on early Reddit a lot so I guess AI probably just writes like I do, not the other way around

  • source
  • hideshow 3 child comments
  • [–] 34 points 2 months ago (11 children)

    Your writing reflects a higher than normal degree of literacy. Ergo, AI use detected.

  • source
  • hideshow 11 child comments
  • [–] 16 points 2 months ago (4 children)

    That, or my man really loves a bullet point and an emdash.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 9 points 2 months ago (2 children)

    I love using emdashes in my papers, but I stopped because of AI

  • source
  • parent
  • hideshow 2 child comments
  • [–] 6 points 2 months ago

    It’s fine, I use em dashes all the time in papers. If you do it correctly—to add more information or commentary to your overall point—instead of at random and without proper syntax you’re not going to get accused.

  • source
  • parent
  • [–] 5 points 2 months ago

    Don't let LLMs take your em dashes; flattening your language to the lowest common denominator to avoid doing anything too distinctive less you be accused of non-authorship.. that's a real harm to you and your reader. If you know how to use them, and enjoy using them, use them fearlessly.

  • source
  • parent
  • load more comments (1 reply)
  • [–] 8 points 2 months ago* (last edited 2 months ago) (1 child)

    It’s actually the opposite. AI writing sounds like corpo-speak. It’s soulless, ugly, and extremely obvious.

    I’ve spent about 30,000 hours reading in my life. If you think I can’t tell you’re using a token predictor for your “essay,” you’re kidding yourself.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 2 months ago

    As someone who has retired from the practice of law and billed clients more than 30,000 hours for legal research over the years, I can assure you that soulless corpo-speech has been around far longer than AI and used to be created organically by depressed human drones and sociopaths. Where do you think the AIs learned to write that way?

  • source
  • parent
  • [–] 1 point 2 months ago (2 children)

    This is why I had to quit school.

  • source
  • parent
  • hideshow 2 child comments
  • [+] -1 points 2 months ago (2 children)
  • [–] 1 point 2 months ago* (last edited 2 months ago) (1 child)

    No, it's cause I was apparently one of the few in my class who actually proofread anything before submitting assignments

  • source
  • parent
  • hideshow 1 child comment
  • load more comments (-1 replies)
  • load more comments (-1 replies)
  • [–] 12 points 2 months ago* (last edited 2 months ago) (1 child)

    Pry those em dashes from my cold, dead hands, Louise.

  • source
  • hideshow 1 child comment
  • [–] 21 points 2 months ago* (last edited 2 months ago)

    Nobody who reads or writes for a living thinks AI slop sounds good. It has a hideous corpo-speak prosody that’s like nails on a chalkboard to professionals.

    People think because they can’t tell it’s not written by a human, someone who has read literally tens of thousands of essays (not to mention millions of fucking book pages) can’t tell either.

    Absolutely bonkers.

    Students who use AI are like little kids standing on each others shoulders in a trench coat and trying to order alcohol.

  • source
  • [–] 8 points 2 months ago* (2 children)

    It's like being accused of aimboting in a competitive shooter. I just take it as a compliment.

  • source
  • hideshow 2 child comments
  • [–] 14 points 2 months ago

    The old witchcraft trial.

    If the paper is so badly written that it fails then it will be declared AI-free. (If she drowns then she wasn't a witch)

  • source
  • [–] 7 points 2 months ago (2 children)

    I don’t have to worry about it because of my numerous tpyos

  • source
  • hideshow 2 child comments
  • [–] 5 points 2 months ago

    Emagine being in an academic filed, and AI being trained off your research papers, so it has the same writing style as you. Give me my em dashes back.

  • source
  • [–] 5 points 2 months ago

    She's possessed by a daemon!

  • source
  • [–] 12 points 2 months ago (2 children)

    There are ways of telling whether she is an AI.

    What are AIs mode out of?

    Silicon!

    What else is made out of silicon?

    Breast implants!

    So logically if she weighs the same as a breast implant...

  • source
  • hideshow 2 child comments
  • [–] 2 points 2 months ago* (last edited 2 months ago) (1 child)

    I was gonna say they're: "Spelled differently (true) and are distinct, unrelated materials (false!)". So I ended up correcting myself.

    Silicone is literally made from silicon. Manufacturing starts with silica (SiO₂, found in sand/quartz), which is reduced to elemental silicon, then reacted with methyl chloride to form methylchlorosilanes, which are then polymerized into silicone.

    The name "silicone" was actually coined in 1901 by English chemist Frederick Kipling, who thought the compounds R₂SiO resembled ketones (hence "-one" suffix): the naming turns out to be a bit of a misnomer chemically, but it stuck.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 2 months ago

    "I follow grammatical rules, yes"-ass rating.

  • source
  • [–] 2 points 2 months ago

    Can’t have you getting away without claiming any AI use or else the Jensen Wong bubble might pop even earlier.

  • source
  • [–] 3 points 2 months ago

    It's like when I used to play Black ops and battlefield 3, eventually because it wad the summer after I graduated, I basically played all day.

    Eventually I was getting accused of using hacks for about 25% of my games.

    The kicker: I wasn't particularly good based on the scoreboard, but after you kill the same guy 3 times through a wall because you can hear his footsteps with your headset and just spray through the wall, he gets suspicious (and probably doesn't play nearly as much)

    I actually was in the top 50 worldwide for MW3 for pistol kills for awhile because for about 2 months all I did in that game was dual wield pistols, sprint after people in games that are more close quarters and go to town on my triggers.

    I always liked being accused of hacking, because it made me feel like I wasn't garbage at the games.

    Now I'd probably get accused of being a default bot lmao

  • source
  • [–] 3 points 2 months ago (2 children)

    Someone I work with who always hand writes his code used copilot to write his commit message as usual this morning.

    Lo and behold it had snuck an "authored by copilot" tag onto the end of the message and github picked up on it and labeled the commit accordingly - when he saw "and copilot" next to his name on github he flipped his lid and ranted about how copilot only exists on the back of stolen code from humans and it has no right to claim any credit whatsoever to anything original like being an author ever.

    He edited out the attribution and force pushed it before anyone else could commit on top of it.

    (Apparently copilot writes commit messages in such a way that no matter how trivial the edit, it sounds like he'd been planning and working for hours and hours on it.)

  • source
  • hideshow 2 child comments
  • [–] 2 points 2 months ago (3 children)

    I used to be extremely careful about my grammar and spelling. I never wanted to be called out for using the wrong there or forgetting punctuation.
    after Ai though, i really don't care. At least im less likely to be taken for a robot.

  • source
  • hideshow 3 child comments
  • [–] 3 points 2 months ago (2 children)

    Excuse me it's I'M or I am, not im.

    What are you, some kind of low ram ai model?

    😅

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 2 months ago (1 child)

    Well, one thing corporate AI won't do is tell you to eat a bag of dicks.

    Soon, being an asshole will be the tell, that you're talking to a meatbag online!

    /s

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 2 months ago

    i was shocked when my article on Adorno and Scruton comparison got rejected because "it reeked AI" even though AI sucks VERY-VERY HARD at analyzing and interpreting philosophy beyond NotebookLM literally retelling the uploaded book. it is so bad there is basically an entire subgenre of philosophy writing analyzing how various AI get it wrong

  • source
  • [–] 1 point 2 months ago

    I did use 60% witchcraft, but they didn't notice since they're too busy looking for AI these days.

  • source
  • [–] 0 points 2 months ago

    The more rules,the more AI the text becomes. So I expect a scientific text with very rigit rules in how to write is practically indistinguishable from an AI text, if written good. So tue expected value is 50% AI or human, if the text is well written. Either the AI got less rules (making it more AI) or humans make mistakes. Either way, a perfectly written text will land at 50% chance.

  • source