274
submitted 11 months ago by girlfreddy@lemmy.ca to c/world@lemmy.world

A sex offender convicted of making more than 1,000 indecent images of children has been banned from using any “AI creating tools” for the next five years in the first known case of its kind.

Anthony Dover, 48, was ordered by a UK court “not to use, visit or access” artificial intelligence generation tools without the prior permission of police as a condition of a sexual harm prevention order imposed in February.

The ban prohibits him from using tools such as text-to-image generators, which can make lifelike pictures based on a written command, and “nudifying” websites used to make explicit “deepfakes”.

Dover, who was given a community order and £200 fine, has also been explicitly ordered not to use Stable Diffusion software, which has reportedly been exploited by paedophiles to create hyper-realistic child sexual abuse material, according to records from a sentencing hearing at Poole magistrates court.

top 50 comments
sorted by: hot top controversial new old
[-] JackGreenEarth@lemm.ee 81 points 11 months ago* (last edited 11 months ago)

As a UK citizen, I'm ashamed of my government.

I am firmly against child abusers, but AI images don't harm anyone and are a safe and harmless way for pedophiles to fulfil their urges, which they cannot control.

[-] Tippon@lemmy.dbzer0.com 33 points 11 months ago

Where does the training data come from to create indecent images of children?

[-] Dran_Arcana@lemmy.world 52 points 11 months ago* (last edited 11 months ago)

It doesn't need csam data for training, it just needs to know what a boob looks like, and what a child looks like. I run some sdxl-based models at home and I've observed it can be difficult to avoid more often than you'd think. There are keywords in porn that blend the lines across datasets ("teen", "petite", "young", "small" etc). The word "girl" in particular I've found that if you add that to basically any porn prompt gives you a small chance of inadvertently creating the undesirable. You have to be really careful and use words like "woman", "adult", etc instead to convince your image model not to make things that look like children. If you've ever wondered why internet-based porn generators are on super heavy guardrails, this is why.

[-] xmunk@sh.itjust.works 11 points 11 months ago

It is true, a 10 year old naked woman is just a 30 year old naked woman scaled down by 40%. /s

No buddy, there isn't some vector of "this is the distance between kid and adult" that a model can apply to generate what a hypothetical child looks like. The base model was almost certainly trained on more than just anatomical drawings from Wikipedia - it ate some csam.

If you've seen stuff about "Hitler - Germany + Italy = Mousillini" for models where that's true (which is not universal) it takes an awful lot of training data to establish and strengthen those vectors. Unless the generated images were comically inaccurate then a lot of training went into this too.

[-] rebelsimile@sh.itjust.works 34 points 11 months ago

Right, and the google image ai gobbled up a bunch of images of black george washington, right? They must have been in the data set, there’s no way to blend a vector from one value to another, like you said. That would be madness. Nope, must have been copious amounts of asian nazis in the training set, since the model is incapable of blending concepts.

[-] xmunk@sh.itjust.works 3 points 11 months ago

You're incorrect and you should fucking know better.

I have no idea why my comment above was downvoted to hell but AI can't "dream up" what a naked young person looks like. An AI can figure that adults wear different clothes and put a black woman in a revolutionary war outfit. These are totally different concepts.

You can downvote me if you like but your AI generated csam is based on real csam so fuck off. I'm disappointed there is such a large proportion of people defending csam here especially since lemmy should be technically oriented - I expect to see more input from fellow AI fluent people.

[-] rebelsimile@sh.itjust.works 27 points 11 months ago

You’re spreading misinformation and getting called out for it.

load more comments (27 replies)
[-] Tippon@lemmy.dbzer0.com 3 points 11 months ago

Thanks for the reply, it's given me a good idea of what's most likely happening :)

It's a shame that the rest of the thread went to shit, but unfortunately it's an emotional topic, and brings out emotional responses

load more comments (1 replies)
[-] Daxtron2@startrek.website 23 points 11 months ago

The whole point of diffusion models is that you can generate new concepts using training data. Models trained on any nsfw images can combine those concepts with any of its non-nsfw concepts. Of course, that's not to say there isn't CSAM in any training data, because there objectively has been in the past, but there doesn't need to be any to generate it.

[-] Tippon@lemmy.dbzer0.com 3 points 11 months ago

Thanks for the reply, that makes a lot of sense :)

[-] Daxtron2@startrek.website 3 points 11 months ago

Thanks for not being a dick! I aim to inform

[-] Turun@feddit.de 11 points 11 months ago

Ai is able to fill in the last field in a table like "Old / young" vs "Clothed / naked" when given three of the four fields.

[-] randomaside@lemmy.dbzer0.com 7 points 11 months ago

Please reiterate your statement but instead using the "goose chase meme" format.

[-] FlyingSquid@lemmy.world 57 points 11 months ago

How could they possibly enforce this ban?

[-] Deceptichum@sh.itjust.works 7 points 11 months ago

Maybe they think he is capable of self enforcing the ruling?

Or that they want the option of gaoling him if they so much as get a hint he’s using one of the services in any capacity.

[-] michaelmrose@lemmy.world 12 points 11 months ago

Why didn't he get banned from using the internet?

[-] Gradually_Adjusting@lemmy.world 8 points 11 months ago

I definitely can't let you do that, Hal.

[-] bloodfart@lemmy.ml 5 points 11 months ago
[-] PotatoKat@lemmy.world 17 points 11 months ago

Just annoyed to see everyone saying with such definitive wording that there isn't any csam in training data. I'm a victim of CSA and can't imagine how I would feel if photos of me were used to help get people off like that.

[-] pory@lemmy.world 11 points 11 months ago

Right? Training data is an absurd blob of everything the algorithm can get its hands on. It's like trying to assure that there's no alcohol or coca-cola in a lake.

[-] bloodfart@lemmy.ml 7 points 11 months ago

It’s great to see you wading into this shitshow with the folding chair, ngl.

[-] autotldr@lemmings.world 4 points 11 months ago

This is the best summary I could come up with:


The Internet Watch Foundation (IWF) said the prosecutions were a “landmark” moment that “should sound the alarm that criminals producing AI-generated child sexual abuse images are like one-man factories, capable of churning out some of the most appalling imagery”.

Susie Hargreaves, the charity’s chief executive, said that while AI-generated sexual abuse imagery currently made up “a relatively low” proportion of reports, they were seeing a “slow but continual increase” in cases, and that some of the material was “highly realistic”.

The Lucy Faithfull Foundation (LFF), which runs the confidential Stop It Now helpline for people worried about their thoughts or behaviour, said it had received multiple calls about AI images and that it was a “concerning trend growing at pace”.

The decision to ban an adult sex offender from using AI generation tools could set a precedent for future monitoring of people convicted of indecent image offences.

Stability AI, the company behind Stable Diffusion, said the concerns about child abuse material related to an earlier version of the software, which was released to the public by one of its partners.

It said that since taking over the exclusive licence in 2022 it had invested in features to prevent misuse including “filters to intercept unsafe prompts and outputs” and that it banned any use of its services for unlawful activity.


The original article contains 974 words, the summary contains 219 words. Saved 78%. I'm a bot and I'm open source!

load more comments
view more: next ›
this post was submitted on 21 Apr 2024
274 points (100.0% liked)

World News

45720 readers
2204 users here now

A community for discussing events around the World

Rules:

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to "Mom! He's bugging me!" and "I'm not touching you!" Going forward, slapfights will result in removed comments and temp bans to cool off.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News !news@lemmy.world

Politics !politics@lemmy.world

World Politics !globalpolitics@lemmy.world


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

founded 2 years ago
MODERATORS