Update: After this article was published, Bluesky restored Kabas' post and told 404 Media the following: "This was a case of our moderators applying the policy for non-consensual AI content strictly. After re-evaluating the newsworthy context, the moderation team is reinstating those posts."
Bluesky deleted a viral, AI-generated protest video in which Donald Trump is sucking on Elon Musk’s toes because its moderators said it was “non-consensual explicit material.” The video was broadcast on televisions inside the office Housing and Urban Development earlier this week, and quickly went viral on Bluesky and Twitter.
Independent journalist Marisa Kabas obtained a video from a government employee and posted it on Bluesky, where it went viral. Tuesday night, Bluesky moderators deleted the video because they said it was “non-consensual explicit material.”
Other Bluesky users said that versions of the video they uploaded were also deleted, though it is still possible to find the video on the platform.
Technically speaking, the AI video of Trump sucking Musk’s toes, which had the words “LONG LIVE THE REAL KING” shown on top of it, is a nonconsensual AI-generated video, because Trump and Musk did not agree to it. But social media platform content moderation policies have always had carve outs that allow for the criticism of powerful people, especially the world’s richest man and the literal president of the United States.
For example, we once obtained Facebook’s internal rules about sexual content for content moderators, which included broad carveouts to allow for sexual content that criticized public figures and politicians. The First Amendment, which does not apply to social media companies but is relevant considering that Bluesky told Kabas she could not use the platform to “break the law,” has essentially unlimited protection for criticizing public figures in the way this video is doing.
Content moderation has been one of Bluesky’s growing pains over the last few months. The platform has millions of users but only a few dozen employees, meaning that perfect content moderation is impossible, and a lot of it necessarily needs to be automated. This is going to lead to mistakes. But the video Kabas posted was one of the most popular posts on the platform earlier this week and resulted in a national conversation about the protest. Deleting it—whether accidentally or because its moderation rules are so strict as to not allow for this type of reporting on a protest against the President of the United States—is a problem.
Assuming you’re asking out of genuine curiosity, for me personally, I’d draw the line somewhere along “could this, or any frame of this, be mistaken for a real depiction of these people?” and “if this were a depiction of real children, how hard would the FBI come down on you?”
I understand that that’s not a practical way of creating law or moderating content, but I don’t care because I’m talking about my personal preference/comfort level. Not what I think should be policy. And frankly, I don’t know what should be policy or how to word it all in anti-loopholes lawyer-speak. I just know that this sucking toes thing crosses an ethical line for me and personally I hate it.
Putting it more idealistically: when I imagine living in utopia, non-consensual AI porn of people doesn’t exist in it. So in an effort to get closer to utopia, I disapprove of things that would not exist in an utopia.
That sounds fair, though I could still see an argument to be made for not always protecting the rich fucks the same way. Either way, we know that anything that comes out that's too incriminating would be declared AI-generated anyway, lol
Though mentioning the utopia... having porn of anyone anywhere might be some people's idea of a utopia! Haha