Incredible to think about that we got it right the first time (with email) and still had to spend the last 20 years complaining about centralized social networks.
My mistake then. I have to give Voyager another try, I guess :)
From what I can tell, the larger instances have frontpages without much user duplication. They have a LOT more memes than I do tho :)
I'll take a look at Superbowl@lemmy.world!
The political posts thing is interesting. So far, mainly news posts with text descriptions remain on the front page (which I personally prefer over the memes, but that's just my preference). I am having a hard time deciding if I actually find them interesting though.. ^^ I think I actually prefer it over my reddit homepage, there tends to be much of the same, usually.
For comparison, see: https://imgur.com/a/xbzMXmQ
I made no changes to the lemmy codebase, its all done through an auto-moderating bot that auto-removes posts that don't meet the standard :)
Yeah, that's one of the potential issues that I'm currently looking out for. So far the main thing I can tell is that memes get removed like crazy (https://lemmy.coffee/c/memes@lemmy.world?dataType=Post&sort=New) and the posts on the homepage are generally much less meme-intensive when compared to instances like lemmy.world or lemmy.ml.
That's the idea, yes.
Do you plan to publish your algorithm/filter?
In an ideal world sure. But I'd have to think about that some more, because in principle I don't want people to game it :)
I added the larger communities before starting to remove posts, so there may be historical posts still hanging around. Maybe everything from BuyFromEU was deleted?
You can see the kind of stuff that stays best via homepage ALL > Top last N hours
I made a Lemmy instance with a custom algorithm that keeps only the top 20% most unique (=interesting?) posts. It does this by calculating a similarity score between every post on my instance and all posts that came before it. The top 80% of posts with the highest self-similarity get removed instantly.
The idea would be that this allows me to cut through the noise that's running through the communities, similar to how xkcd-signal attempted to do 20 years ago.
The instance is mostly meant for reading, not posting. So it has a very open federation policy (for now).
If anything, this is experimental. So please let me know what you think! You can see the type of stuff that gets removed in the modlog (https://lemmy.coffee/modlog).
I do very few things explicitly, I just punish self-similarity in a very specific way. I guess posts with actual text in the body are just more unique, given all previous posts on the instance.
Maybe using the filtered posts as a base in combination with some client side keyword blocking will be useful? The keyword blocking would be much more individual for each user.