172
submitted 1 year ago by L4s@lemmy.world to c/technology@lemmy.world

AI-generated child sex imagery has every US attorney general calling for action::"A race against time to protect the children of our country from the dangers of AI."

top 13 comments
sorted by: hot top controversial new old
[-] DarkSpectrum@lemmy.world 74 points 1 year ago

Isn't AI generated better than content sourced from real life? It could actually drive a reduction in child sexual abuse instances due to offenders leveraging alternative sources.

[-] doggle@lemmy.dbzer0.com 31 points 1 year ago

I see what you're saying, but ai has yet to offset regular porn production at all. There's no reason I see to think accepting ai cp would do anything but normalize it and make it more accessible, possibly increasing demand for the real stuff.

Also, the ai models need to be trained on something...

[-] Tibert@compuverse.uk 15 points 1 year ago

No it won't.

Fueling the child addiction will harden the persons mental health problem.

One of the ways to help a person with such addiction, is to replace it with adult pornography.

Fueling it with more of that content won't do any good.

[-] philodendron@lemdro.id 14 points 1 year ago

Alternatively it could become an indoctrination pipeline

[-] krayj@sh.itjust.works 9 points 1 year ago* (last edited 1 year ago)

One big problem is that it makes enforcement of real abuse impossible. If there is an explosion of that kind of ai generated content and it gets good enough to be confused for the real thing, then real abuse will slip under the radar. It would be impossible to sift through all that content trying to differentiate between ai generated and real if ai generated were ever allowed.

[-] Asudox@lemmy.world 4 points 1 year ago

This feels like a double edged sword.

[-] uriel238 56 points 1 year ago

In the United States, there are significantly greater dangers to kids than AI porn. Hunger, poverty and the climate crisis come to mind.

If we are refusing to address these for ideological reasons (e.g. because its socialism ) then the established system itself is a threat to kids.

Priorities.

[-] Sanctus@lemmy.world 39 points 1 year ago

Pandora's digital box has been opened. And I dont think this one ends with everything going back in the box.

[-] autotldr@lemmings.world 12 points 1 year ago

This is the best summary I could come up with:


On Wednesday, American attorneys general from all 50 states and four territories sent a letter to Congress urging lawmakers to establish an expert commission to study how generative AI can be used to exploit children through child sexual abuse material (CSAM).

In particular, open source image synthesis technologies such as Stable Diffusion allow the creation of AI-generated pornography with ease, and a large community has formed around tools and add-ons that enhance this ability.

Since these AI models are openly available and often run locally, there are sometimes no guardrails preventing someone from creating sexualized images of children, and that has rung alarm bells among the nation's top prosecutors.

Establishing a proper balance between the necessity of protecting children from exploitation and not unduly hamstringing a rapidly unfolding tech field (or impinging on individual rights) may be difficult in practice, which is likely why the attorneys general recommend the creation of a commission to study any potential regulation.

In the past, some well-intentioned battles against CSAM in technology have included controversial side effects, opening doors for potential overreach that could affect the privacy and rights of law-abiding people.

Similarly, the letter's authors use a dramatic call to action to convey the depth of their concern: "We are engaged in a race against time to protect the children of our country from the dangers of AI.


The original article contains 960 words, the summary contains 225 words. Saved 77%. I'm a bot and I'm open source!

[-] ram@lemmy.ca 9 points 1 year ago

A lot of people here really defending child pornography

[-] Serdan@lemm.ee 27 points 1 year ago

It's an obvious overreach.

An AI generated image is essentially the solution to a math problem. Say the images are/become illegal. Is it then also illegal to possess the input to that equation? The input can be used to perfectly replicate the illegal image after all. What if I change a word in the prompt such that the subject of the generated image becomes clothed? Is that then suddenly legal?

I understand the concern, but it's just incredibly messy to legislate what amounts to thought crimes.

Maybe we could do something to discourage distribution, but the law would have to be very carefully worded to prevent abuse.

[-] Absolutemehperson@lemmy.world 2 points 1 year ago

And everyone pointing that out gets downvoted into oblivion, rofl. I hate the internet and the sick degenerates on it.

[-] Blue2a2@sh.itjust.works 5 points 1 year ago

I'm sure it is entirely coincidental that the call to action is to restrict/control the free open-source software, and leaves Google and Microsoft safely in control with their curated models.

This is just like the time the US made websites responsible for their users' content, and coincidentally made it much more legally dangerous to start your own social media platform.

But sure, I mean, just think of the (imaginary) children! We need to stop this theoretical abuse of imaginary children by passing laws that make it harder for any AI not created by a tech giant to operate.

this post was submitted on 07 Sep 2023
172 points (100.0% liked)

Technology

58160 readers
2794 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS