labels that the people you were labeling didn’t even like
This is a silly criticism. "Latinx" and similar terms were used by some US kids of Latin-American descent and those people felt the "X"-ed words provided them better representation. Many native Spanish speakers didn't feel represented and objected to the terms being applied to them. So: there were two (maybe even more???) groups of people and they didn't agree on one label being applied to both of them.
It doesn't make sense to say that this is a problem with "woke" (wtf does that even mean) because the "non-woke" alternative is to use labels that people don't like... exactly the thing you're complaining woke did wrong. It's not a change making us worse off, it's just a failure to deliver total success. (Maybe it failed to deliver even partial success here? That's a conversation that might be worth having, but "worse off" seems like a straight hallucination.)
Now, if you want to say, "I have a big criticism of progressive movements: they do not succeed to the degree that they promise!" then sure. You should get in line behind literally every person who has ever considered themselves progressive, because all of them have also come up with this brilliant piece of insight and are eager to share it.
"Exactly as horrible" is unfair to you. But it sounds like you're advocating to give up on rule of law and just have the strongest most violent people be the ones to decide what's right. And I'd argue that you'd just get back to where we are right now: wealthy people would control the system, they'd employ strong violent people to enforce their personal whims as "law", and you'd be complaining that nobody is willing to beat up the pedophile (because his friends would hire goons to kill them).
I mean, presumably that's what's stopping you personally from implementing your own recommendation, right? Because if you showed up and kicked this guy's ass you'd be beaten and arrested by the police.