358

A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.

you are viewing a single comment's thread
view the rest of the comments
[-] echo64@lemmy.world 37 points 8 months ago

Every time this comes up, all the tech nerds here like to excuse it as fine and not a bad thing at all. I am hoping this won't happen this time, but knowing lemmys audience...

[-] sbv@sh.itjust.works 19 points 8 months ago

The Lemmy circlejerk is real, but excusing deep fake porn is pretty off brand for us. I'm glad the comments on this post are uniformly negative.

[-] echo64@lemmy.world 11 points 8 months ago* (last edited 8 months ago)

https://sh.itjust.works/comment/10397565

https://kbin.social/m/technology@lemmy.world/t/927248/-/comment/5921190 just accept it as a new normal, it's fine. Can't possible have any recourse, just accept it women of the world, it's the new normal!

[-] sbv@sh.itjust.works 2 points 8 months ago

Okay, there are a couple of douche canoes, but generally speaking, I think we're okay on this one.

[-] echo64@lemmy.world 2 points 8 months ago

It is massively upvoted (for lemmy).

[-] roscoe@lemmy.dbzer0.com 11 points 8 months ago

I think part of the difficulty discussing this is the discussions usually combine two different things. The production and distribution.

I was informed elsewhere in this thread people can already produce these images/videos on their own machines with no third parties involved or remote processing. I can't think of a single thing that can be done about that so acceptance is all we've got.

Nonconsensual sharing, on the other hand, we can and should do something about. The legal system won't be able to stop it altogether but it can push it to the fringes and stop it from becoming mainstream so any victims wouldn't see fake images/videos of themselves proliferating everywhere.

[-] cley_faye@lemmy.world 4 points 7 months ago

It's not a matter of excusing it. Distribution of someone's picture without their explicit consent, and anything like that, is inexcusable. But we're talking about the generation of said content, which technically can't be stopped without seriously restraining everything.

this post was submitted on 29 Mar 2024
358 points (100.0% liked)

Technology

59598 readers
2912 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS