top 88 comments

sorted by: hot top controversial new old
[–] 57 points 2 months ago (9 children)

I realized my assignment went through an originality checker, which I guess is safer than calling it a plagiarism checker.

Still felt odd that it flagged a quote I used from the source book, in the section asking for a quotation. I would've thought it'd at least disregard things between quotation marks.

What's even dumber is that it flagged a single instance of the word "the", just the word not the sentence it was in. I don't know why, but I guess that specific "the" was unoriginal.

  • source
  • hideshow 9 child comments
  • [–] 27 points 2 months ago (2 children)

    When I was in college all my papers were automatically submitted to TurnItIn when I uploaded them to the submission Dropbox. Every use of the singular word "the" was flagged as plagiarism. Every time.

    Call me a dishonest copying cheater.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 131 points 2 months ago (30 children)

    Does it think it's AI because it was trained on it so it recognizes it as being part of AI now?

  • source
  • hideshow 30 child comments
  • [–] 11 points 2 months ago (29 children)

    It was posted like some kind of gotcha but....this book was in the dataset.

    I'm aware that LLMs don't keep the dataset in memory but it "knows" that this is an existing work but these sites aren't doing any wild calculations to figure out if it was AI-generated. They basically just check to see if the sentences exist elsewhere and they do. In the original dataset.

    So it was wrong to say it's AI-generated but it correctly identified that it's not original.

  • source
  • parent
  • hideshow 29 child comments
  • [–] 93 points 2 months ago (9 children)

    They analyze statistical patterns, they don't cross reference the training data.

    It's picking up the text as generated because it's mostly guess work and constantly spits out false positives, especially with non native speakers.

  • source
  • parent
  • hideshow 9 child comments
  • [+] -6 points 2 months ago (8 children)

    Honestly I didn’t expect them to flag non-native speakers. LLMs don’t often make gramatical mistakes (or at least not ones your average joe could identify)

  • source
  • parent
  • hideshow 8 child comments
  • [–] 48 points 2 months ago (6 children)

    Foreign speakers often know English better than most Americans

  • source
  • parent
  • hideshow 6 child comments
  • [–] 6 points 2 months ago* (last edited 2 months ago)

    Oooh yeah, the most common dumb mistakes are (by my own checking) done by Americans in the VAST majority cases. Stuff like not knowing how to use your/you're, there/their/they're, cloths/clothes, definitely/defiantly, where/were/we're, its/it's etc. correctly and the many other failings of basic grammar like "would/could of" and so much else.
    I don't think there's another country in the world where the native speakers are so fucking bad at even the most basic shit.
    The most common response I've gotten and seen when others correct stuff like that is "calm down, English probability isn't their main language" yet when checking it's been Americans who made the mistakes 99% of the time.

  • source
  • parent
  • [–] 3 points 2 months ago (3 children)

    The decline I've seen in my time on the internet is genuinely shocking

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 2 months ago

    Weirdly enough i saw a massive increase in little typoes on reddit this year. More typoes and such in a few months than i saw in years.

    It feels like LLMs started making mistakes on purpose.

  • source
  • parent
  • [–] 32 points 2 months ago (2 children)

    That is not in the least bit how a tool like this works.

    All AI detection is extremely unreliable, but they operate on principles which, if the assumptions supporting them were true, would be sound. The way you imagine they work is different: you're describing a "novel text detector" which is not at all the same thing as an "AI text detector".

    AI detection works, at a very high level, by throwing a bunch of examples of AI text, and a bunch of examples of non-AI text, into a machine-learning model, and training it until it is able to recognise the AI examples as such. It doesn't work by throwing in all existing text including novels written before AI, because that would never do what you want.

    (The reason, if you're interested, why this ends up not working is because the features such a model identifies as indicative of AI text are very sensitive: if you train it on Claude and ChatGPT, it will not work on Gemini output. If you train it on Gemini, when Gemini updates it will get worse. If someone generates text with a weird prompt, it may slip by. If someone writes in a weird way, it may get flagged. And if any AI company wanted to defeat AI detectors, it could trivially feed its output through one during the training process and give that output as examples to avoid in the training, so that the model learns to create output which doesn't "look like" AI output to those detectors.)

  • source
  • parent
  • hideshow 2 child comments
  • [–] 2 points 2 months ago (1 child)

    I was being overly simplistic - I meant more that the patterns it's trying to detect were created by an LLM trained on the data they're inputting.

    It's like how reddit comments from 2016 look generated. If you stick one of those into an AI detector, it'll give a false positive for the same reason

  • source
  • parent
  • hideshow 1 child comment
  • [–] 4 points 2 months ago (11 children)

    I'm sorry, what? It's correctly identified that it's what, now?

  • source
  • parent
  • hideshow 11 child comments
  • [–] -2 points 2 months ago (10 children)

    It's original in the book. What the user entered is an exact copy.

    "Original" is not the correct work but you know what I mean.

  • source
  • parent
  • hideshow 10 child comments
  • [–] 5 points 2 months ago (8 children)

    The little scale thing doesn't say it is 100% not original, it says it is AI/LLM generated.

  • source
  • parent
  • hideshow 8 child comments
  • [–] -2 points 2 months ago (7 children)

    Yes...because the pasted text has some of the exact patterns that are part of the dataset that the website trained on...because that dataset contains text generated from a dataset containing the exact paragraph...

    I feel like you're being deliberately obtuse.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 6 points 2 months ago* (5 children)

    I feel like you don't understand the difference between 'AI generated' and 'something that existed over 200 years ago'.

  • source
  • parent
  • hideshow 5 child comments
  • [–] -2 points 2 months ago (4 children)

    I feel like you don't understand that LLMs train on text that existed 200 years ago...

  • source
  • parent
  • hideshow 4 child comments
  • [–] 1 point 2 months ago (3 children)

    So you confirm that you don't understand the difference. Ok.

  • source
  • parent
  • hideshow 3 child comments
  • [–] -2 points 2 months ago (2 children)

    Sorry for not answering your idiotic question. Also sorry that you're dead set on deliberately misunderstanding then doubling down on it. Hope it makes you feels smart!

  • source
  • parent
  • hideshow 2 child comments
  • [–] 0 points 2 months ago (2 children)

    Everything you said was hallucinated. Nothing you said was even slightly coherent or connected with reality. Absolutely nothing was correct. If you let your cat dance on the keyboard more sense would come out.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 3 points 2 months ago (1 child)

    That must have sounded really clever and powerful in your head for you to hit send, huh? Couldn't decide which zinger to go with so you sent all 4?

    I'd have given you more credit if you just posted the quote from Billy Madison. Try harder lol

  • source
  • parent
  • hideshow 1 child comment
  • [–] 44 points 2 months ago (1 child)

    Intelligence is knowing that Frankenstein is the doctor. Wisdom is knowing that Shelley vibe coded the entire story.

  • source
  • hideshow 1 child comment
  • [–] 42 points 2 months ago*

    Uses Ai to detect the use of Ai

  • source
  • [–] 34 points 2 months ago (2 children)

    To be fair, the monster was artificial and intelligent.

  • source
  • hideshow 2 child comments
  • [–] 31 points 2 months ago

    Shit like this happens if you train your AI on every god damn fucking text on earth.

  • source
  • [–] 30 points 2 months ago

    It's a 100% match on what the model was trained on.

  • source
  • [–] 29 points 2 months ago

    AI is like: "i made this"

  • source
  • [–] 22 points 2 months ago (1 child)

    And this is the "unseen" loss of value. Can you imagine writing a book (by hand the old-fashioned way -- maybe with just a text editor) and submitting it to publish and the publisher rejects it as "written by AI?"

  • source
  • hideshow 1 child comment
  • [–] 16 points 2 months ago

    This is absolutely the biggest source of anxiety I have right now as someone who has been writing a really heartfelt novel for over a decade. (Things got delayed due to... personal stuff. Also I started drinking beer like a proper author. It didn't help, actually.)

    Back when I started this, I had been publishing some short stories under CC licences. I guess that has to be an option once again (and as much as I hate it as an open source nerd, -NC might make an appearance.)

  • source
  • parent
  • [–] 20 points 2 months ago (1 child)

    Loved it when he met The AI Bride of Frankenstein.

  • source
  • hideshow 1 child comment
  • [–] 17 points 2 months ago

    All the villagers of the data center got their pitchforks.

  • source
  • [–] 29 points 2 months ago (1 child)

    We're using AI to determine what is AI, even though AI doesn't know what AI is.

    Perfectly reasonable, no careers will be destroyed, surely

  • source
  • hideshow 1 child comment
  • [–] 14 points 2 months ago

    I postulated exactly these issues with detecting LLM code in software projects, making "no LLM code"-type policies unenforceable. It doesn't work most of the time now, and it will only get worse in the future.

  • source
  • [–] 25 points 2 months ago (6 children)

    I've been commenting on the open, public internet in some form or fashion since the 1900s. These models have been trained to sound like me, not the other way around. Fortunately, the bullies at the back of the class who don't pay attention have mostly caught on to this fact, after having it repeated to them hundreds of times. The other day I was thinking about it, and realized it's been a bit since anybody's accused me of using AI to write a comment. I think it's because I stopped proofreading what I write. Leave in those mistakes and the assholes at the back of the room who don't pay attention are too naive to think that machines can't make mistakes, I guess.

  • source
  • hideshow 6 child comments
  • [–] 17 points 2 months ago (5 children)

    What was the Internet like in 1900? IP over Avian Carriers?

  • source
  • parent
  • hideshow 5 child comments
  • [–] 11 points 2 months ago

    Ahead of her time. But, then again, we all knew that.

  • source
  • [–] 11 points 2 months ago (3 children)

    false positives exist, and the real monster is that it also happens with "faces" of criminals.

  • source
  • hideshow 3 child comments
  • [–] 11 points 2 months ago (5 children)

    Shouldn't it be easy with today's computing power to simply search all content first for a match to known sources?

  • source
  • hideshow 5 child comments
  • [–] 4 points 2 months ago (3 children)

    Wouldn't necessarily tell you if that known source is AI. So now we have to go through everything by hand anyway.

  • source
  • parent
  • hideshow 3 child comments
  • [–] 3 points 2 months ago (2 children)

    Of course it can, if it's from 1859 the chances of it being AI are .... I leave that as an exercise for the reader.

  • source
  • parent
  • hideshow 2 child comments
  • [–] 10 points 2 months ago (1 child)

    I made a machine with the purpose of literally creating output that plausibly sounds like a human wrote it.

    Now that it creates things that sound plausibly like they came from a real person it's a problem. Now quick make something else that pretends to know it's not human when the whole point of the damn machine is to sound human.

    Tjciiktn it's ridiculous. HMsie?$+'izhav!&(:8_! This world is so fucked

  • source
  • hideshow 1 child comment
  • [–] 7 points 2 months ago

    There was an old lady who swallowed a fly, I don't know why she swallowed a fly – perhaps she'll die!

    There was an old lady who swallowed a spider That wriggled and jiggled and tickled inside her; She swallowed the spider to catch the fly; I don't know why she swallowed a fly – perhaps she'll die!

    There was an old lady who swallowed a bird; How absurd to swallow a bird! She swallowed the bird to catch the spider That wriggled and jiggled and tickled inside her, She swallowed the spider to catch the fly; I don't know why she swallowed a fly – perhaps she'll die!

    There was an old lady who swallowed a cat; Well, fancy that, she swallowed a cat! She swallowed the cat to catch the bird, She swallowed the bird to catch the spider That wriggled and jiggled and tickled inside her, She swallowed the spider to catch the fly; I don't know why she swallowed a fly – perhaps she'll die!

    There was an old lady that swallowed a dog; What a hog to swallow a dog! She swallowed the dog to catch the cat, She swallowed the cat to catch the bird, She swallowed the bird to catch the spider That wriggled and jiggled and tickled inside her, She swallowed the spider to catch the fly; I don't know why she swallowed a fly – perhaps she'll die!

    There was an old lady who swallowed a goat; Just opened her throat and swallowed a goat! She swallowed the goat to catch the dog, She swallowed the dog to catch the cat, She swallowed the cat to catch the bird, She swallowed the bird to catch the spider That wriggled and jiggled and tickled inside her, She swallowed the spider to catch the fly; I don't know why she swallowed a fly – perhaps she'll die!

    There was an old lady who swallowed a cow; I don't know how she swallowed a cow! She swallowed the cow to catch the goat, She swallowed the goat to catch the dog, She swallowed the dog to catch the cat, She swallowed the cat to catch the bird, She swallowed the bird to catch the spider That wriggled and jiggled and tickled inside her, She swallowed the spider to catch the fly; I don't know why she swallowed a fly – perhaps she'll die!

  • source
  • parent
  • [–] 8 points 2 months ago

    Why are people so quick to place their faith in machines?

  • source
  • [–] 15 points 2 months ago

    The monster was created by a vibe-surgeon.

  • source
  • [–] 7 points 2 months ago

    confidently incorrect

  • source
  • [–] 18 points 2 months ago (6 children)

    Before anyone goes on a wild goose chase, this excerpt is on the opening of Chapter 4 instead of 5 in the first edition.

    Anyone surprised to find that public domain art is determined to be AI generated does not realize that feeding an LLM requires a lot of art, and public domain is the easiest one to come across. AI detectors, as far as I know, check AI signs, and (most) AI signs came from their use by public domain artworks.

  • source
  • hideshow 6 child comments
  • [–] 4 points 2 months ago (2 children)

    Anyone surprised to find that public domain art is determined to be AI generated does not realize that feeding an LLM requires a lot of art, and public domain is the easiest one to come across.

    Yeah no we definitely realize that.

    Wouldn't that mean that it should be better at identifying public domain work?

  • source
  • parent
  • hideshow 2 child comments
  • [–] 4 points 2 months ago (2 children)

    So, all the AI bullshit floating around, along with the requisite tech bros owners, is beneficial to society as a whole because they steal art that was no longer protected by copyright? My first question is always "If it all went away would anything change?".

  • source
  • parent
  • hideshow 2 child comments
  • load more comments
    view more: next ›