all 10 comments

sorted by: hot top controversial new old
[–] 17 points 8 months ago (2 children)

Yeah, that's sad.

And he's correct. AI "detectors" as he describes are both wrong, useless, and doomed to fail.

But there are better ways to get hints. Specific models tend to overuse certain tokens: they'll pick the same character names for a story, or overuse certain phrases, and if you play when them long enough you start to recognize "oh, that's an OpenAI" model, or "this is dry like Nvidia Nemotron," or whatever.

See EQBench's slop profiles: https://eqbench.com/

But, ultimately, the way to fix this is to go back to trusted sources and citations.

  • source
  • hideshow 2 child comments
  • [–] 11 points 8 months ago

    This man is a fucking hero. He’s got the concept built just right; I’ve been trying to slap it together much more awkwardly, for years.

    I’m not a robot, I’m just following the rules of the language I learned.

  • source
  • [–] 8 points 8 months ago (2 children)

    Fascinating stuff, and it makes sense that a more rigid, rules-based version of English would be both taught in ESL schools and learnt by an LLM.

    If I start a sentence, "The cat sat on the...",

    Me: "mat"

    your brain, and the AI, will predict the word "floor."

    Oh. I'm not sure that's the best example, as that particular phrase is something many children encounter when learning to read.

    Also, British English would close the quotes before the full stop (aka period) finishes the sentence - is that something he's picked up since school or is that something that's changed since the Kenyan model of perfect English was set?

  • source
  • hideshow 2 child comments
  • [–] 2 points 8 months ago* (last edited 8 months ago) (1 child)

    [British] I'm fairly sure I was taught to put the full stop before the closing quote, but that's perhaps only for dialogue?

  • source
  • parent
  • hideshow 1 child comment
  • [–] 1 point 7 months ago

    It was that you could use quoted punctuation to punctuate a sentence, but you shouldn't quote anything that's not part of the quote. For example, you wouldn't say

    The first word of that popular birthday song is "happy."

    This would suggest that the first line goes "Happy. Birthday to you" whereas you could just finish after the quote: first word is "happy".

    Also, compare

    He said "hello"?
    He said "hello?"
    He said "hello?"?

    All mean different things, although that last one does look very odd.

  • source
  • parent
  • [–] 7 points 8 months ago (1 child)

    What's stupid about people saying only LLMs use emdash and the sentence lists of threes, is that's exactly how we learned to write throughout our Canadian highshool curriculum.

    And if you read dialog or narratation in books, its full of emdash asides in sentences.

  • source
  • hideshow 1 child comment
  • [–] 4 points 8 months ago

    I only recently learnt about how em-dashes had a separate name, thanks to its popularisation by people trying to detect LLMs.

    Earlier, I just thought of them as just a longer dash and I used them when manually writing (often made them longer than 2 characters), but just used a normal dash when typing.

  • source
  • parent
  • [–] 1 point 7 months ago

    I have not known Kenyans to be huge sycophants

  • source
  • 4 comments in c/technology@lemmy.ml view that post
    [–] 9 points 10 months ago

    The machine, in its quest to sound authoritative, ended up sounding like a KCPE graduate who scored an 'A' in English Composition. It accidentally replicated the linguistic ghost of the British Empire.

    Combined with how the academic community has been warning about encoding biases since way before the current hype cycle, this sentence is mildly horrifying

  • source
  • [–] 5 points 10 months ago (1 child)

    How unfortunate to speak 'AI', when people are currently scrambling to build 'AI detectors' that removes AI speak from their feeds. Good luck buddy 😵

  • source
  • hideshow 1 child comment
  • [–] [S] 7 points 10 months ago

    What I find most unfortunate is that these scam companies convinced people that you can make AI speech detectors in the first place. Like the reason LLMs structure text in a certain way is because these are the patterns in human text that they've been trained on.

  • source
  • parent
  • [–] 2 points 10 months ago

    What a surprise. I makes me think of the US women treating Eastern Asian women who married western men like whores, victims, or gold-diggers. Many people think about the world locally, not internationally. They apply their ways of thinking to the rest of the world and have trouble understanding that what is normal for me isn't normal for you (and vice versa). They have trouble understanding that things aren't always as they seem and making a summary judgement about a person from a short slice of their life, which they can interpret wrong, does not a person make.

  • source
  • 2 comments in c/hackernews@lemmy.bestiver.se view that post
    [–] 7 points 10 months ago (1 child)

    There’s a growing community (cult?) of self-proclaimed AI detectives, who have designed and detailed what they consider tells, and armed their followers with a checklist of robotic tells. Does a piece of text use words like ‘furthermore’, ‘moreover’, ‘consequently’, ‘otherwise’ or ‘thusly’? Does it build its arguments using perfectly parallel structures, such as the classic “It is not only X, but also Y”? Does it arrange its key points into neat, logical triplets for maximum rhetorical impact?

    Good luck if you write beyond a fifth grade level.

  • source
  • hideshow 1 child comment