169
submitted 1 day ago by neme@lemm.ee to c/technology@lemmy.world
you are viewing a single comment's thread
view the rest of the comments
[-] Opinionhaver@feddit.uk 11 points 1 day ago

I couldn't agree more. Human moderators, especially unpaid ones simply aren't the way to go and Lemmy is a perfect example of this. Blocking users and communities and using content filters works to some extent but is extemely blunt tool with a ton of collateral damage. I'd much rather tell an AI moderator what I'm interested in seeing and what not and have it analyze the content to see what needs to be filtered out.

Take this thread for example:

Cool. I think he should piss on the 3rd rail.

This pukebag is just as bad as Steve. Fuck both of them.

What a cunt.

How else is anyone going to filter out hateful content like this with zero value without an intelligent moderation system? People are coming up with new insults faster than I can keep adding them to the filter list. AI could easily filter out 95% of toxic content like this.

[-] MissGutsy 3 points 1 day ago

Interesting fact: many bigger Lemmy instances are already using AI systems to filter out dangerous content in pictures before they even get uploaded.

Context: Last year there was a big spam attack of CSAM and gore on multiple instances. Some had to shut down temporarily because they couldn't keep up with moderation. I don't remember the name of the tool, but some people made a program that uses AI to try and recognize these types of images and filter them out. This heavily reduced the amount of moderation needed during these attacks.

Early AI moderation systems are actually something more platforms should use. Human moderators, even paid ones, shouldn't need to go though large amounts of violent content every day. Moderators at Facebook have been arguing these points for a while now, many of which have gotten mental issues though their work and don't get any medical support. So no matter what you think of AI and if it's moral, this is actually one of the few good applications in my opinion

[-] mPony@lemmy.world 3 points 1 day ago

Moderators at Facebook have been arguing these points for a while now, many of which have gotten mental issues though their work and don’t get any medical support

How in the actual hell can Facebook not provide medical support to these people, after putting them through actual hell? That is actively evil of them.

[-] MissGutsy 1 points 1 day ago

I agree, but it's also not surprising. I think somebody else posted the article about kenyan Facebook moderators in this comment section somewhere if you want to know more

load more comments (1 replies)
load more comments (1 replies)
load more comments (4 replies)
this post was submitted on 02 Mar 2025
169 points (100.0% liked)

Technology

63614 readers
2531 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS