512
submitted 6 months ago by misk@sopuli.xyz to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] peanuts4life 60 points 6 months ago

It's worth mentioning that in this instance the guy did send porn to a minor. This isn't exactly a cut and dry, "guy used stable diffusion wrong" case. He was distributing it and grooming a kid.

The major concern to me, is that there isn't really any guidance from the FBI on what you can and can't do, which may lead to some big issues.

For example, websites like novelai make a business out of providing pornographic, anime-style image generation. The models they use deliberately tuned to provide abstract, "artistic" styles, but they can generate semi realistic images.

Now, let's say a criminal group uses novelai to produce CSAM of real people via the inpainting tools. Let's say the FBI cast a wide net and begins surveillance of novelai's userbase.

Is every person who goes on there and types, "Loli" or "Anya from spy x family, realistic, NSFW" (that's an underaged character) going to get a letter in the mail from the FBI? I feel like it's within the realm of possibility. What about "teen girls gone wild, NSFW?" Or "young man, no facial body hair, naked, NSFW?"

This is NOT a good scenario, imo. The systems used to produce harmful images being the same systems used to produce benign or borderline images. It's a dangerous mix, and throws the whole enterprise into question.

[-] ricecake@sh.itjust.works 12 points 6 months ago

The major concern to me, is that there isn't really any guidance from the FBI on what you can and can't do, which may lead to some big issues.

https://www.ic3.gov/Media/Y2024/PSA240329 https://www.justice.gov/criminal/criminal-ceos/citizens-guide-us-federal-law-child-pornography

They've actually issued warnings and guidance, and the law itself is pretty concise regarding what's allowed.

(8) "child pornography" means any visual depiction, including any photograph, film, video, picture, or computer or computer-generated image or picture, whether made or produced by electronic, mechanical, or other means, of sexually explicit conduct, where-

(A) the production of such visual depiction involves the use of a minor engaging in sexually explicit conduct;

(B) such visual depiction is a digital image, computer image, or computer-generated image that is, or is indistinguishable from, that of a minor engaging in sexually explicit conduct; or

(C) such visual depiction has been created, adapted, or modified to appear that an identifiable minor is engaging in sexually explicit conduct.

...

(11) the term "indistinguishable" used with respect to a depiction, means virtually indistinguishable, in that the depiction is such that an ordinary person viewing the depiction would conclude that the depiction is of an actual minor engaged in sexually explicit conduct. This definition does not apply to depictions that are drawings, cartoons, sculptures, or paintings depicting minors or adults.

https://uscode.house.gov/view.xhtml?hl=false&edition=prelim&req=granuleid%3AUSC-prelim-title18-section2256&f=treesort&num=0

If you're going to be doing grey area things you should do more than the five minutes of searching I did to find those honestly.

It was basically born out of a supreme Court case in the early 2000s regarding an earlier version of the law that went much further and banned anything that "appeared to be" or "was presented as" sexual content involving minors, regardless of context, and could have plausibly been used against young looking adult models, artistically significant paintings, or things like Romeo and Juliet, which are neither explicit nor vulgar but could be presented as involving child sexual activity. (Juliet's 14 and it's clearly labeled as a love story).
After the relevant provisions were struck down, a new law was passed that factored in the justices rationale and commentary about what would be acceptable and gave us our current system of "it has to have some redeeming value, or not involve actual children and plausibly not look like it involves actual children".

[-] retrieval4558@mander.xyz 8 points 6 months ago

Is every person who goes on there and types, "Loli" or "Anya from spy x family, realistic, NSFW" (that's an underaged character) going to get a letter in the mail from the FBI?

I'll throw that baby out with the bathwater to be honest.

[-] Duamerthrax@lemmy.world 36 points 6 months ago* (last edited 6 months ago)

Simulated crimes aren't crimes. Would you arrest every couple that finds health ways to simulate rape fetishes? Would you arrest every person who watches Fast and The Furious or The Godfather?

If no one is being hurt, if no real CSAM is being fed into the model, if no pornographic images are being sent to minors, it shouldn't be a crime. Just because it makes you uncomfortable, don't make it immoral.

[-] Ookami38@sh.itjust.works 26 points 6 months ago

Or, ya know, everyone who ever wanted to decapitate those stupid fucking Skyrim children. Crime requires damaged parties, and with this (idealized case, not the specific one in the article) there is none.

[-] DarkThoughts@fedia.io 11 points 6 months ago

Those were demon children from hell (with like 2 exceptions maybe). It was a crime by Bethesda to make them invulnerable / protected by default.

[-] helpImTrappedOnline@lemmy.world 21 points 6 months ago

Simulated crimes aren't crimes.

If they were, any one who's played games is fucked. I'm confident everyone who has played went on a total ramapage murdering the townfolk, pillaging their houses and blowing everything up....in Minecraft.

[-] Maggoty@lemmy.world 3 points 6 months ago

They would though. We know they would because conservatives already did the whole laws about how you can have sex in private thing.

[-] mindbleach@sh.itjust.works 1 points 6 months ago

The part involving actual children is go-to-jail territory, because it involves actual children.

The images don't.

There's as much "child sexual abuse" in a generated image as in a crayon drawing of Bart Simpson fucking Lisa. Anyone's visceral reaction may differ between the two JPGs, but we should treat them the same because they are the same.

this post was submitted on 21 May 2024
512 points (100.0% liked)

Technology

59612 readers
2894 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS