Ban them.
Lemmy is so young (and feeble) that users like those are an actual threat to your community and the larger network by driving away those who actually contribute to the community. In 2019, TrueBirch from Reddit analysed the data and concluded that only 1.9% of users actually comment or post while 98.1% just lurks. When your community is has a thousand or so users, it's entirely reasonable to protect those ~20 users who are creating content for the rest. In fact, the majority of the rest likely don't upvote things either.