19
LLM vigilance on the Fediverse is lacking (lemmy.dbzer0.com)
submitted 2 weeks ago by to c/fediverse@lemmy.world
45 comments fedilink hide all child comments
 

the image linked to by the post is the Pangram LLM-detection report of paragraphs in the first screenshot below, reading "100% AI". in lieu of alt text for the screenshots below, I suggest scrolling through @eicker@lemmy.world's profile and https://lemmy.world/comment/26323310, which the screenshots are of. Look at the vote counts.

you are viewing a single comment's thread
view the rest of the comments
[–] 5 points 2 weeks ago (3 children)
  1. They do not all write the same. There's benchmarks for this and if you just do a basic search or actually test them yourself you'll see that their output differs wildly. Not only between vendors, but been versions of the same model. For example, Claude stopped using em dashes for most output for a while but now they've come back.
  2. There's vastly more than "a handful of models"! Are you living under a rock‽ Go to HuggingFace today and then again tomorrow. There's going to be a dozen new ones! Probably more!
  3. Changing the back end configuration even a tiny bit can vastly change the output of a model.
  • permalink
  • fedilink
  • source
  • parent
  • hideshow 3 child comments
    •
  • [–] 0 points 2 weeks ago (2 children)

    They do not all write the same

    They all have the same hallmarks.

    There's vastly more than "a handful of models"! Are you living under a rock‽

    You're intentionally misrepresenting my statement. It wasn't about the models that exist, it was about the models people are using.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 2 child comments
    •
  • [–] 2 points 1 week ago (1 child)

    I'm not misrepresenting anything. If you take any model and just change the temperature a little bit (it's a setting that controls the influence of the RNG) you can have wildly different output.

    Different AI providers using the exact same model will have outputs so different using the same exact prompts you'd think they were in different universes.

    They absolutely do not "have the same hallmarks."

    This stuff is benchmarked to absurd degrees every time a new model comes out. Just look it up already! You're so obviously arguing from an ignorant position it's silly.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] -2 points 1 week ago*

    I'm not misrepresenting anything

    You absolutely did. So much so that you didn't even bother to explain yourself.

    I don't need to look up anything. It's been shoved in my face for the last 5 years. You are so obviously arguing about nuances that don't matter in reality and it's ignorant and silly! Things like em-dashes, bullet points, and gargling the user's balls are all signs that everyone who's paying attention can quickly and easily recognize at this point.

  • permalink
  • fedilink
  • source
  • parent