151
Internet Watch Foundation reports huge rise in AI child sexual abuse material (www.theguardian.com)
submitted 1 month ago by to c/technology@lemmy.world
26 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] 17 points 1 month ago (10 children)

The companies that produce these images should be prosecuted for each and every one. They must have safeguards against stuff like this out go out of business.

  • permalink
  • fedilink
  • source
  • hideshow 10 child comments
    •
  • [–] 27 points 1 month ago* (last edited 1 month ago) (5 children)

    This is the pretext for taking away individual's rights to general computing -- because once all the providers have guard rails and are locked out, individual users with local hardware are the last source for 'illegal content'. "We have to scan everything you do on your local computer, or you could be doing something we don't approve of". https://lemmy.world/post/52743759 <-- see this story up on the front page just now. She (foolishly) thought her prompts in OpenAI were private to her, and now she's charged with "sending a threat in a way that others can read" -- we won't be able to use our computers for private diaries or planning anymore the more they get locked down to only 'approved' data and programs.

    And remember, it starts with CSAM, and then it moves on to "illegal content", then "terrorist content" -- and how many times has the Trump said "if you are against the president and the laws I'm enforcing, you must be a terrorist?" ....

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 5 child comments
    •
  • [–] 8 points 1 month ago

    Sorry, what? The other side of this coin is not regulating companies like OpenAI and them using their enormous level of influence to push whatever they want. When a large part of the population uses these platforms, and any (political) query always gets replied to with an answer that fits what they want to achieve, what happens?

    The potential power these AI companies hold is horrifying. They absolutely should be regulated.

  • permalink
  • fedilink
  • source
  • parent
  • [–] 2 points 1 month ago

    Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -1 points 1 month ago* (1 child)

    What companies? Only grok had serious problems (which are fixed by now, supposedly). Rest of the companies models cannot generate such stuff, this is all done with custom models by individuals.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 10 points 1 month ago

    this is all done with custom models by individuals.

    This is really important for people to understand.

    Powerful open weight models are already out there. Anyone can download them and run them. There is no possibility for government control of AI content without North Korean style internet controls.

    Politicians and corporations will absolutely start trying to push for more controls. They will tell you to "think of the children" and they will use this to take power for themselves, knowing full-well that they can't actually meaningfully prevent this from happening. We need people to understand that the push for control here has nothing to do with morality or protecting anyone.

  • permalink
  • fedilink
  • source
  • parent
  • [–] -1 points 1 month ago (1 child)

    Fine, as long as you agree to prosecute also all companies that produce software to work with images (or generate them without using AI), every company that produce software that can be used to create 3d models and then the renderer that get these models and render them into photorealistic images.
    Then you need to go after everyone who produces plugins fot these softwares. And then you need to go to every open source software that do the same thing and every person who contribute to them.
    And maybe even hardware vendors that sell graphics tablets for drawing.

    Sometime it seems that, especially with AI, people think that the solution is to ban the tool and not to punish who use it to do something illegal.
    True, AI make it extremely easy to create such horrific images but AI is not the first tool to do so, it make only faster. Back at the time there were entire Usenet groups dedicated to fake nude/xxx images of persons, both celebrities and normal people, but we have not banned internet, we simply prosecuted (when/if caught) who created the images.

    Yeah, that these images are repulsive, but prosecute the companies that make tools that can also generate them was like to prosecute a phone company because someone use a phone to plan and commit an homicide.

  • permalink
  • fedilink
  • source
  • parent
  • hideshow 1 child comment
    •
  • [–] 2 points 1 month ago

    Another commenter mentioned that most of the major platforms do have safeguards against this stuff at this point and are more being done with local models. That’s my ignorance and I’m sorry about that. I would agree with you in general - what you do on your local device should be private, which will protect a lot of important usage but also some nefarious usage. Terms and conditions of freedoms.

    I was thinking of how Grok in particular was just open to generating these sorts of images without any guardrails. In my mind that was similar to a company producing deadly chemicals without any guardrails for preventing it from poisoning everyone around.

  • permalink
  • fedilink
  • source
  • parent