We do not allow our child's image online anywhere. School, sports, social media, whatever ... no thanks.
post
Gork went online about 3 years ago...
One concerning thing is that when these AI companies are pushed to crack down on this, they'll retrain and bias their models to only recognize traditional "pornstar" body types as 'adult'.
This is a problem when they then get used as a mass content flagging and moderation tool — it's not hard to imagine some adult woman taking nudes (as people do) and just because they don't have a huge bust, getting auto flagged as having illegal material. Not to mention body types that aren't even real, like the art made in furry communities.
It's not like there isn't precedent, recently Discord banned a ton of people because its scanning system started throwing false positives, and that was only corrected because it made such a stink.
Yeah we will drown in flase postives, my other worry is they will spend on this auto scaning of media call it problem solved slash bugets for other things and predators move to dumb tech or really encoded shit.
Thats if there even is enouth money/compute to scan everything.....
There was a story a while ago where some dude was about to be convicted of possession for a few videos of a young looking woman. The prosecution even had an expert witness that repeatedly testified that it was impossible for an adult woman to look this way and wouldn't be budged at all on cross examination. Luckily, at the 11th hour, the defense found the porn star, who was actually somewhat famous but the videos didn't contain her stage name. She took the stand, a 20-something looking like a 13yo, and the case was dismissed.
If this shit is automated there will definitely be a lot of false positives. And it will be automated, and it will be a "wide net" pulling in all kinds of stuff like you mentioned and more. And no one will really care to make it work better because "the children". Meanwhile, the will be no additional effort to stop harm to actual children because...well, I think we all know why. Sloppy, performative, bullshit is what we'll get instead of measures to prevent and help victims.
This sounds like an urban legend, do you remember the time/location or any names for this case?
Yup, took a little digging though, I couldn't remember the name off the top of my head. Back when this happened she would be a top result for "young Latina" on all the big sites, but I think the algorithms favour newer videos so I had to scroll several pages before I recognised her. If you want to read more about it Google "case dismissed Little Lupe."
I remember reading about this myself in a major news outlet specifically because I recognised the name at the time. Although she isn't my type, absolutely no breasts and hips isn't for me, if you use search terms for youthful actors, ones like this will also come up. Like I said, she was somewhat big at the time and I saw her name often.
Here is another link with some more info. I did forget some details. The biggest one is the video was labelled with her name but the prosecutor refused to do a simple record search (all of her movies were compliant with the applicable laws regarding this), or accept all the evidence the defendant's lawyer presented them with, and the defense had to fly her in to testify.
Oh wow thats fascinating, thanks for your detective work!
Our whole system of “expert witnesses” in courtrooms is woefully broken and under-regulated.
Yeah, the whole "expert witness" thing really needs some sort of regulation and consequences for spouting bullshit in a courtroom. I don't know how old you are, but I'm old enough to have loved The Forensics Files, and I don't even know how many times I've read an article or watched a documentary about someone who got their conviction overturned, or about ongoing efforts to do so, that seem very familiar and I realize I saw it on that show or another one years ago and the cutting edge forensics that were used are now considered complete bullshit.
They should be made to retrain their models using only images of those palaeolithic venus figurines.
This is a problem when they then get used as a mass content flagging and moderation tool — it's not hard to imagine some adult woman taking nudes (as people do).
The problem is with sexual abuse material not nudity on its own, there is a clear distinction between those two. It seems like this is the major problem when it comes to "crack-downs" on this.
I think the demand for this is significantly higher than most people think, they're not doing this to kill time. They're making a fortune on it somehow.
Eliminating it will just alleviate one symptom, not treat the disease or lessen the demand.
Yes, they certainly are, and most of the major platforms are being used for this and it's widely known. Copilot's prompt reviewers reported it to Microsoft, per leaked documents. Grok has been known to be in use for this basically since its inception. Meta's LLM is used for it, and they know.
I can't speak for Gemini, Claude, or ChatGPT, but it wouldn't surprise me at all if they're being used for it too.
These platforms are unregulated by anything other than civil lawsuits (though some international governments are starting to move on it), so yes, they're going to appeal to every demographic, including the worst of the worst, in a desperate bid to one day be profitable.
There was one guy arrested for it recently, a state-level deputy AG, but that dude's the exception. Hopefully there will be more to come.
I researched this topic recently and made a video about it.
This is a genie out of the bottle problem. People can just run their own models and do this.
The problem with subscription models doing this is that they are fighting investigations and laws to keep doing it, not stop it.
Aren't local models also protected against this sort of usage?
If you train the mode yourself, then the only restrictions are what you put in place.
Training models is easy. Especially if you only need it to do one thing.
I have never heard anyone say training models is easy. But abilterating or making heretic versions of already trained models does seem to be pretty easy.
Those protections are easily stripped. Or you could just find stripped models.
Ohhh, I'm so gonna use this.
"You can't put the genie back in the bottle. You literal cannot stop it from making infinite pedophilia now. Petabytes of naked children. Look, the way I see it is, AI is a tool, the technology already exists, so you're just gonna have to learn to live comfortably in an endless sea of horrible, horrible sex crimes being generated daily. It's simply not possible to stop it."
In the usa it's become more a point of pride rather than something broken that should be fixed. /s
https://tsjournal.org/index.php/jots/article/view/29
exposure to csam, through self reporting, increases the risk the viewer will seek contact with children, in case you need more arguments against csam. I've heard the argument that AI generated images may be a harm reduction situation. it's not. it's incredibly damaging to the viewer if they are seeking it out, it makes them more likely to abuse, if they are exposed to it as victims it can cause lasting damage, much of it is just remixed images of actual child abuse victims, and that revictimizes them, and causes serious damage as well. We really need to stop pretending the companies that make this software aren't responsible for this software.
So why is this a different effect to video games and violence?
I think it's relation to the content. Violent games are widespread and often played by individuals who don't dream of bringing a rifle and shooting everybody.
CSAM, however, is primarily watched by individuals who are already mentally inclined towards child abuse. They would want to have sexual/romantic interaction with children IRL, and they either already do it or are stopped by morality, legality and other factors while still having the urge.
Oh boy, do you show how young you are.
Violent video games were definitely not widespread before, and there definitely were plenty of people saying this back then even in the 90s. I remember seeing a CSPAN coverage where American Republicans were specifically saying only the sick and twisted would want to play Mortal Kombat.
Yes, the first one, which at the time looked like this:

They weren't calling for regulations or research, but a ban. And yes, there were "studies" of small sample sizes they presented too.
It's especially important to stay level headed and rational when it comes to what we may instinctively find disgust in, because you don't fix societal issues with pure demonization. Currently the way most treat pedophilia is the same way I saw people treated those who had HIV.
What we should be doing is figuring out why some people have these pedophilic tendencies, and trying to cure it. We still need to keep the legal punishments for committing actual rapes of course, but if you make the existence of a pedophile itself essentially illegal, then you won't see them coming out to seek help before they potentially do something heinous, much like an addict does not necessarily start out as a thief to get their next fix. And that'll make it harder to fix the roots of the issue.
Instead, you'll see it used as a cudgel by the corrupt who are above the law anyway used to oppress the general population and get rid of anyone they dislike, much like they've done in the past with drugs (crack cocaine), political ideology (communism's red scare), and even homosexuality before that (see what happened to Turing).
Indeed, I agree with the last part. We should tread carefully with policy here, for two main reasons:
- We still have exceptionally little evidence one way or another, which is honestly insane given the topic's importance
- "Protect the children" narrative is commonly abused for tyrannical laws that trample otherwise unrelated freedoms. I can easily see how this narrative can transform in broader AI oversight in a way that tramples democracy and fair access to information.
I merely addressed the "why is this different" issue. You're unlikely to even want to watch any form of CSAM unless you're into this, i.e. unless you're a pedophile. You don't have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.
CSAM attracts a very specific demographic, and we need to make sure we understand how AI-generated CSAM affects this demographic and whether it induces real life abusive behaviors, or maybe represses them. And yes, it is also important to understand how it affects children, how likely they are to find such materials, and how it affects their sexual development. But this part is exceptionally hard to study, because you can't just take children and expose them to CSAM to see how it's going.
You don't have to be a sadistic psychopath to enjoy wreaking havoc in GTA or beating the hell out of your opponent in Mortal Kombat.
I mean, I personally don't find those things appealing and wonder how you can enjoy those things, but it's been shown to reduce aggression. Crime went down as violent video games went up too - I know, correlation isn't causation - but I could see for example how a cousin of mine would have been more likely to join the local gang if he couldn't instead be home playing GTA as a teen.
You're unlikely to even want to watch any form of CSAM unless you're into this, i.e. unless you're a pedophile.
CSAM yes, but there's an important distinction that's been blurred in recent years and I think it's no coincidence - the distinction between CSAM and pedophilic content. CSAM involves actual human children - it's in the name. Pedophilic content however can include content that doesn't include actual children, like drawings.
When you have an unevenly enforced justice system, who does it benefit to square the two? If the ruling class is full of pedophiles who actually rape children, then putting CSAM in the same rank as a drawing benefits them. It would be the same as saying a snuff film is as bad as a movie with props. And that benefits them, because it makes CSAM seem less bad than it is, while giving them expanded powers against those they don't like. Calling something AI-generated CSAM (assuming it's from a model that wasn't trained on any specifically) makes it seem that what people like Trump do is actually just as bad as a basement dweller geberating pedo content. The reality is one is FAR more horrific than the other.
On everything else you said, I mostly agree. I just want to point out for point 1, I was alive during the right when there was little research or evidence about violent video games too. Yeah, movies and books like that existed, but that wasn't as immersive because those mediums aren't interactve, and that was the important distinction back then.
Violent games have been shown to reduce aggression
Yes, but we don't know if it translates the same way to CSAM. That's why we desperately need more studies. Before then, any stance is just a wild guess.
The distinction between CSAM and pedophilic content
Indeed, I use CSAM as an accepted broad term, even though, if AI was not trained on real CSAM, sexual abuse was not involved. You raise an interesting political point on why we shouldn't.
Other than that, we need to know several things when considering legality of such options:
- Is real CSAM involved in a given model training data
- Does consumption of different forms of AI-generated content increase or decrease real world sexual abuse rates
- Is there any distinction between hyperrealistic AI-generated content and drawing-like content in terms of real world behaviors and training data
- How can we protect children from being exposed to such content online - and how incidents of it happening anyway affect sexual and mental development of children
Powerful people may intentionally put equality between real-life CSA and AI-generated content
That's an interesting angle to look at. So, we also need to know how normalization or criminalization of AI-generated materials affect public perception of real world CSA. Makes sense.
why would watching children be abused from real or stimulated sources be the same as playing a violent video game?
You're right. A video game is far more interactive. Heck these days you can even put on a headset and really simulate the action of murdering people. Grand Theft Auto is a whole detailed simulation on muder, theft, and more. Wayyy more immersive than just plain video.
Clearly then, by your own logic and the study's conclusion, watching simulated sources make people more likely to do the thing after all. I mean, what sick person fantasizes about murdering strangers?
Obviously we must ban the existence of violent video games or crime in society will spiral out of control.
Edit: for the younger lemmings, this is sarcasm. "Fake X causes more real X" is really old propaganda, and its usually used on something most of the population already finds morally objectable + is harmful to society to advance some ulterior motive.
In this case, probably government spying and the erosion of privacy, as usual.
your doing A LOT here, friend. I'm not sure I can unpack this... I'm not suggesting playing Grand Theft Auto is going to make anyone more likely to commit violent crimes. I don't see the connection with csam. I don't think the effects of viewing csam is equivalent or similar to playing a video game. I've played GTA, it's really not an instruction manual or stimulation of detailed murder or violence, honestly, it's a bit silly and while modern versions of the game are more detailed than the early versions of the game that were graphically more similar to Frogger than anything else, it's still not very detailed. if you needed a murder equivalent to csam I think gore and 'faces of death' type of videos would be more comparable, video games are marketed to be fun and are rated and regulated pretty heavily in most areas of the world, AI generated csam isn't being caught up in that same process of regulation or review, multiple corporations have made software that is producing AI generated csam and no one is really holding them accountable like you or me would be if we personally increased the reported rates of csam by huge orders of magnitude. we'd be in prison. the software isn't free from the corporations that made it. they made it, they should be held accountable.
Oh shit so you're actually just a fucking pedo.
And you're too young to remember back when the same talking points were used against video games to try to ban them or against movies and books "promoting" drugs. This isn't a new thing. "Fake X causes more of Real X to happen!" Has being going on for decades if not over a century and has always been used for an ulterior motives.
Making up statistics to find yet another way for governments to justify eliminating privacy isn't going to save children or stop pedophilia, much like banning video games wouldn't reduce gun deaths and banning drugs doesn't really reduce drug use. The root cause is elsewhere.
But you go ahead thinking your virtue signaling makes things better. I'm sure your name calling tactic will totally make a difference.
I think perhaps, child sexual abuse material can be treated differently than video games. certainly it's not related to anything I was talking about. it's pretty absurd to connect 'hay these AI companies released software that's creating csam, let's stop this and hold them accounting' to 'let's stop video games.' these are very distinctly different things. I'm not suggesting thought crime laws or laws to prevent anyone from buying or consuming video games or anything related to that, that world is already rated and regulated. AI software creating scam is not. that's the problem. not video games. why do you even think this is related, it's absurd.
I think there's some confusion on your part.
I'm not against what the main topic is about - holding companies legally liable for training on CSAM material. They should be, because they have possession of CSAM.
What I'm against is the illegalization of non-CSAM material until it's proven detrimental to humans, because otherwise it will be used as an excuse to lock up political opponents and erode privacy. This is not hypothetical, this is already observable. And yes, that does mean material that depicts disgusting acts with characters that appear to be children, including those stupid "but she's actually 1000 years old" the Japanese seem to be fond of using. Because that is not CSAM, since literally no children were sexually abused, much like shooting someone in a video game isn't actually murdering someone. It's definitely pedophilic content, but then again at least it doesn't hurt someone directly. To me it's the equivalent of Portugal's drug program where opiod addicts can go to pharmacies to get clean needles and cheap pharmacy grade opiods. And I think it's no coincidence that countries that ban that and restrict research into it are all part of spying exchange programs like 5-Eyes.
Nor do I think it's a coincidence that those countries leaders are pedophiles.
Because when you ban things like this, you _don't _ get rid of them, you just push them underground. And paradoxically, what is known is that when something is fully banned, use of if rises (the forbidden fruit effect). You can see it anywhere where drugs are legalized. You can see it in history with the temperence movement. You can even see it with violent video games, where the controversy around it made younger children play them more back then than they do now.
Banning non-CSAM pedophilic material likely results in the same effect. And just like with drugs and other such things, it will result in people getting hurt. In this case, actual childen.
If the material is actually proven harmful to society, then additional steps can be taken, such as curing or treating pedophilia, if that's possible. But its researched way too little to know if that's the case due to its taboo status.
I'm not suggesting thought crime laws or laws to prevent anyone from buying or consuming video games or anything related to that, that world is already rated and regulated.
Except the arguments you make are the exact ones made way back to do exactly that to video games, and it wasn't always rated and regulated... I'm not sure how you don't get that point.
For the record, I personally don't play video games that are too violent. I don't find pleasure in the simulated killing of humans or grotesque deaths - especially if they are depicted as innocents like in GTA. Being alive (and younger) during that time period, I thought that maybe those senators had a point. But when science showed it decreased aggression overall and when regulations were implemented, that was that. So I have first hand experience with knee-jerk reactions to things I find disgust with. But I've come to learn better since then that the solution to social problems is rarely if ever than banning of something, as easy a solution that would be.
Well it's different because video games aren't created by comsuming and averaging out every piece of footage of children being raped that grok can find on the internet. Hope this helps.
This study explores a sample of 1,546 anonymous individuals
I have a study of 23023012301230123050503450 anonymous individuals, of which 78% agreed that you smell like doo doo. Yep. True story. If you disagree, you hate science. How could you do this?
I shouldn't be this sarcastic, the journal is called " Journal of Online Trust and Safety (JOTS) " with a name like that, how could I ever be so arrogant to not believe 1546 anonymous individuals on the internet? Shame on me, really.
Agreed, studies on this topic are always what someone on the other end wants to hear. The premise is inconsistent and the conclusion doesnt hold. If this study was done about something less "taboo" it would've been lost and forgotten.
Seems to be run by academics
If we're appealing to authority, then let me promise you that I too have an academic degree.
That fallacy doesn't mean "nobody knows more than me".
reddit moment...
you can't just dismiss an argument because the study is small. Sure it's small, but it's not easy to get large data on this subject.
The concept of csam exposure influencing behaviour is highly plausible.
I agree with the plausibility of the concept, but anonymous surveys aren't really something we should be calling a "study". They're barely considered evidence as they're open to extreme errors, bias, and manipulation; especially by respondents.
The concept of csam exposure influencing behaviour is highly plausible.
The entire scientific community and publishing industry is a minefield. So is CSAM and the call for more restrictive governing of the internet.
The thing I know for sure is that there are people on this planet who have a political and a financial motive to lie and fabricate studies to justify their politics.
The thing I'm mostly skeptical on is the scientific process. Not because it can't work, but because that entire field too, has bad incentives. "Reputation" is held up, frankly, by boomers who have trouble operating a printer, but did some important theoretical work before the internet was made public and by politics and a disinterested public that doesn't apply scrutiny to what their "intellectual elite" is actually doing.
The internet is a KNOWN source of bad information. Those 1546 "anonymous individuals" could be one bored 4chan user, or one chinese/russian/us spy agency worker justifying the next expansion of their budget.
is highly plausible.
Is not science. It's guesswork.
I appreciate that it is difficult to collect good information on this subject, but that's just how it is. Tough luck. As a scientist, a proper scientist, you don't get to publish "it's plausible" from a source you can't verify as fact.
Second guessing science isn't anti-science.
wow it sounds like you hate surveys and science. sorry about that.
my comment on an internet news article was that child sexual abuse material even if generated by AI isn't a harm reduction, as it is shown to cause harm in multiple ways. if you want to argue that being exposed to csam as a viewer isn't harmful to the viewer or doesn't make them feel more inclined to abuse children in real life, that's fine, you can do that AND hate science. it's OK, man.
I'm not trying to get you to agree surveys and science as a whole are valid.
Questioning the validity of methodologies and results is a core part of the scientific method.
"It has surveys, so it must be legit" is not.
where did I make that claim?
where did I make that claim?
wow it sounds like you hate surveys and science. sorry about that.
implying the points raised don't have merit and are just the ramblings of a science (and survey) hater.
I’m not trying to get you to agree surveys and science as a whole are valid.
again, implying that somehow the points raised are only due to disagreeing with science (and again surveys for some reason)
especially when the rest of your reply is just restating your original claim and not responding to any of the raised points.
"this person must hate science and surveys" is the contextual equivalent of someone saying "hey perhaps we should not allow children to work 12 hour days in factories" and you replying with "this person must hate freedom".
It's completely ignoring the point and claiming victory anyway.
what point? they said they thought science as a whole is corrupt and unreliable. they wrote a whole paragraph about it. what do you want me to dispute? that they think science as a whole is corrupt and surveys are made up? what's the rebuttal possible? 'well sir, surveys are possibly valid and not entirely made up.' what do you want? there's no substance to any of their claims beyond 'I think it's all made up and science is corrupt and therefore meaningless'. my counter argument is ''OK, I don't care if you feel that way, you're allowed, good day' and your coming at me like an obvious sock puppet that's only interested in arguing nonsense instead of having ANY point about the subject at hand. good job. I totally agree with you and your correct on all points.
what point?
The reply is still there, if you want me to copy and paste each point from that reply, i can, but it seems redundant.
they said they thought science as a whole is corrupt and unreliable. they wrote a whole paragraph about it. what do you want me to dispute? that they think science as a whole is corrupt and surveys are made up? what’s the rebuttal possible? ‘well sir, surveys are possibly valid and not entirely made up.’ what do you want? there’s no substance to any of their claims beyond ‘I think it’s all made up and science is corrupt and therefore meaningless’.
I think i see the issue i'm having, i thought you were legitimately deflecting out of an unwillingness to engage with the conversation.
That's my bad.
I had a different take on their reply so i was seeing your reply through my interpretation of the post you were replying to.
They are very negative about the current state of science as a discipline, the poor practices, corruption and rot that exists.
I'm not seeing the general hatred of science though, just their perception the a lot of the current implementation of science is shitty.
The main point i see them making is that you shouldn't take a single (potentially suspect) result that is potentially influenced by all these shitty practices and claim "high plausibility" off of the back of that.
They go into a little detail about their idea of good practices, but that can be inferred from their description of the bad practices.
‘OK, I don’t care if you feel that way, you’re allowed, good day’ and your coming at me like an obvious sock puppet that’s only interested in arguing nonsense instead of having ANY point about the subject at hand. good job.
Regardless of my misunderstanding, my initial reply is still valid.
Calling someone a sock puppet with no supporting evidence is weak.
I was arguing that your interpretation of how science (and yes, surveys) are applicable here, was shaky and you might want to reconsider.
If you don't think that's relevant, you're entitled to your opinion.
I totally agree with you and your correct on all points.
just FYI, you can just say "i don't want to talk to you anymore",
there's also the block list if you really dislike me,
i think there's a lemmy(general?) etiquette option as well, something like /disengage , not sure how widespread that is though.
sorry I took a self reporting survey that claims to only be a self reporting survey as valid to an argument that I knew pedantic internet waffles would bad faith argue about so why not get ahead of it and include a source. In the future everytime I include a published source of any information I'll include
CAUTION: take all of reality with the possibility everything is made up and everyone is always lying into consideration! Careful! it might all be a lie! have you ever personally been to Cleveland? maybe it's not real....
sorry I took a self reporting survey that claims to only be a self reporting survey as valid to an argument that I knew pedantic internet waffles would bad faith argue about so why not get ahead of it and include a source.
Positioning yourself as a victim of big bad internet bullies who are picking on your extremely sound argument for no reason at all is certainly one way you could go.
Claiming bad faith will probably require a well reasoned argument if you want to be taken seriously, so best to prepare for that also.
In the future everytime I include a published source of any information I’ll include
CAUTION: take all of reality with the possibility everything is made up and everyone is always lying into consideration! Careful! it might all be a lie! have you ever personally been to Cleveland? maybe it’s not real…
The difference between:
"highly plausible"
and
"this single, survey-based study suggests".
Ultimately it's your call how you present your information.
If you choose to present information in a way that that has previously garnered skepticism or comment, then expect potentially the same outcomes if you do it again.
You can also continue to be upset when you get that kind of reaction, perhaps upset at the state of internet commenters is warranted, you do you.
If you continue to be surprised however, that's on you.
Also everybody knows cleveland isn't a real place, if you're going to try and catch me with your made up geographic locations, at least pick something plausible, like Llanfairpwllgwyngyllgogerychwyrndrobwllllantysiliogogogoch or Hooker
Aside from the other good replies you have around the subject, i'll address something more fundamental to your argument.
you can’t just dismiss an argument because the study is small.
You absolutely can dismiss a study for being too small. In some cases you really should.
If you can't procure and retain a meaningful sample size, then you shouldn't be running the experiment (or more usefully, designing an experiment that works with smaller sample sizes, or one that uses a demographic where you can get adequate sample sizes).
It's one of the reasons why participant gathering is usually done up front.
True. But over 1500 responses is a massive sample size for a survey like this.
I haven't read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.
True. But over 1500 responses is a massive sample size for a survey like this.
Genuine question, based on what?
Like, I'm just seeing a number, I've no idea if it's big or small in the context of this area of study.
I'd be interested to know why that's considered a good result.
I haven’t read the actual study yet, but I would assume they filtered out things like one person submitting a thousand responses.
Agreed, I'd assume a basic level of scientific rigour.
https://www.research-advisors.com/tools/SampleSize.htm
I don't know what the total population is here (people interested in CSAM? everyone on earth?) but 1500 responses gets you a 2.5% margin of error with 95% confidence on a population of 300 million people (a bit less than the entire US).
Maybe not dismiss, but you can think twice before giving it much credit.
The government is currently looking at making anti-semitism a zero-tolerance offence in schools, in the wake of the Bell Review, which showed that 41% of Jewish pupils had suffered anti-semitic abuse at school. These are indeed troubling numbers, but baffling as 70% of British Jewish pupils are in Jewish schools. Are nearly 20% of anti-semitic incidents really occurring in Jewish schools? Or is it a flaw in the study, which had a sample size of 92 children of which 70 responded?
If we just need to be plausible, then why bother with the time and expense of studies at all? Sure, its plausible that antisemitism is on the rise in schools, but so are exclusions to a truly troubling all-time high. Is it really wise to add greatly to that number based on the experience of 29 study respondants? That isn’t even a classroom’s worth.
Small data sets can severely distort results and need to be taken with that firmly in mind.
Nice to see my comment get destroyed. I agree with all of you on the importance of being rigorous in science, and that self reporting surveys are not reliable.
The reasoning that made me comment was: I think original commenter is making an argument in good faith. You can dismiss the study, but then at least argue the point? Surely everyone agrees that the opposite view -- that AI generated csam could reduce harm -- is insane???
Thanks for sharing this!
I do wonder though if it actually translates to AI-generated CSAM. People who go for the real CSAM already get to accept harm caused to real children, while AI-generated one doesn't necessarily feed off real CSAM - or at least not all people expect it to.
There's also a matter of legality - stepping into the criminal side by watching/storing/distributing real CSAM may embolden people to do further criminal acts.
Finally, AI-generated CSAM can take various shapes. Do realistic depictions affect pedophiles the same way more cartoonish depictions are? This is not obvious.
I'm not saying your conclusion is wrong, it could be completely right, but we have criminally little data on the topic. We NEED better research ASAP, because what we have now in terms of policy is still very much vibes-based, and it shouldn't be like that. We need to know what we're stepping in here, and what really needs to be done.
AI generated images also make it harder for police to protect real children
perverts have run under the radar for so long theyve increased their numbers and the availability of ai just feeds it
Yeah... That'll happen when the AI company's country of origin deems it completely legal.
What are you saying is completely legal? Aigenned CSAM?
Yes. That's what Trump and elons America does. They ruled it totally fine and legal to make. What else were they going to do charge elon with a crime for grok making it? No way this is America, men like assaulting children here, and that's what the law reflects.
Honestly that's a really good point. Where the fuck did the training data come from? If AI can only make what its trained on. I hadn't really thought about that in relation to this. How isn't that a bigger talking point?
On the one hand, diffusion models can merge concepts together pretty well (think of those bird-cat chimeras).
On the other hand, yes, there's CSAM in training data. A while ago researchers scanned and validated thousands of CSAM images in the training data of just one dataset. This one in particular the backbone of the popular Stable Diffusion.
In comparison, how much did image generation in general rise in that time frame?
Is there a bit of whataboutism at the end of that line of thinking? I think there is.
No, I just would like to see this in a general perspektive. 8400% sounds rather extreme for any figure rising over just a few years, but I have no idea how big that is in perspective.
Add to this that official numbers about CSAM are often bloated (there was a case years ago where the police claimed they had thousands of CC numbers to identify members of such a forum, in the end they got maybe a dozen culprits because most CC numbers turned out to be stolen).
No, it's a statistically sound question, the answer to which is essential to have a meaningful understanding of the statistics. If AI image generation went up 100000% in the same time, that means a smaller proportion of users are making CSAM, which could tell us something about a change in audience for AI. On the other hand, if general image generation went up 10%, then this would mean many users have started making CSAM that weren't before, or that the users who were making it are now making much more. And all of this really depends further on the ratio beforehand. A percent increase is just not a very meaningful way to report this important information.
We should always encourage asking logical and scientific questions about things, even (in fact, especially) when the face-value interpretation aligns with our existing understanding. "Percentage increase" reports are famously capable of being misleading.
Lastly, "whataboutism" is often used incorrectly, due to its unfortunate name, people think that any time someone's question or issue might be phraseable as "what about XYZ", that that's whataboutism. But it really, really isn't. Please read this https://en.wikipedia.org/wiki/Whataboutism , because I fear that the confusing terminology may be steering you wrongly.
Since no one had AI anything a few years ago; all things that could possibly be done by AI are up 8,400% over the past two years.
Oh look. Taking pictures has gone up 3,859,643,000,134% since 1827.
With the first case of AI related abuse a few years back, there was a more than 1242458842257963234564900521% increase compared to the years before !!!111oneeleven
all 76 comments