AI can cheaply fake almost every signal we traditionally used to judge quality. I now see this pattern everywhere, in open source, in education, in research, all breaking at the same time. I find signaling theory useful for diagnosing what is happening and why it is so disorienting, and signaling theory and adjacent literature can provide the vocabulary to discuss possible solutions.

you are viewing a single comment's thread
view the rest of the comments
[–] 12 points 1 day ago (5 children)

I don't entirely agree with the doom and gloom of that article. Humans are particularly good at adapting to changes. And humans are particularly good at detecting patterns and anti-patterns. Patterns are signals, and while adaption will take a while and will be painful, I think we'll work it out. For example, detecting AI slop reliably and intuitively is a skill that more and more people learn. Once the pattern is learnt, it's a new useful signal. Other new signals emerge for quality detection. In a world of crap software, the few that work well will stand out. Anything that can be "created" by anyone with a few prompts loses its value. What's valuable will be what stands out from the slop.

  • source
  • hideshow 5 child comments
  • [–] 15 points 22 hours ago (1 child)

    If what you are saying was true, propaganda wouldn't work.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 21 hours ago

    That's the part about the painful process I mentioned. The dumb masses were always dumb and they will be the last to adapt. We're in the Programming community and therefore might be a little earlier, as tech people are often early adopters of new ideas. I mean, the fact that you are using Lemmy is a sign that you want to try something more progressive, while most of the general public are happy with X, Instagram and Reddit.

  • source
  • parent
  • [–] 6 points 20 hours ago (1 child)

    Learning to identify AI made content is currently possible in some cases, and as things are, we're fast approaching the situation when it won't be possible in most cases. I don't think we can adapt this in that way.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 2 points 17 hours ago

    True, that might happen at some time in the future, I'll believe it when I see it. But at the moment most of the generated images or texts are only good enough if a human sloperator does some quality control and regenerates or edits the results until they look good. All the models i've seen so far have specific quirks/preferences which repeat as patterns. This might not be immediately apparent when a new model comes out, but it takes a lot less time to identify the quirks than it takes to train the model in the first place.

    To be clear, I'm not implying that I couldn't be fooled by a genAI text or image, but the majority of uncontrolled zero-shot slop is easy to spot, because it is just that, slop. Look at any random slop readme.md in a github repo for example. The structure is always the same, it is filled with a collection of words that tries to mimick what a readme would look like, including weird jargon imitations but it lacks the clarity, personal touch, developer ego and soul it would have if a real author was writing about his own cherished creation. Look for the things that are absent instead of the things that are there. Same for identifying slop images... Image Gen focuses on the subject and gets sloppy on the "less important" bits, like backgrounds.

  • source
  • parent
  • [–] -2 points 23 hours ago

    I'm fairly Ai positive myself, I just want to point out that Ai is better at detecting patterns than humans are.

    For example, detecting AI slop reliably and intuitively is a skill that more and more people learn.

    This is true, I also have this skill right now, but I have no confidence it will still be useful 2 years from now.

    Anything that can be “created” by anyone with a few prompts loses its value.

    What is value exactly, commercial value? Just because it took 3 prompts to create a great tool or the 11th season of Friends does not mean those don't have personal value or can give you a huge productivity boost or entertainment.

  • source
  • parent