I mean that would make sense if Antifa had anything to do with fascism. It's just one of many movements wearing labels that intentionally misrepresent it's members.
It's like being anti-Patriot act and then others claiming that you're against patriotism.
You're playing into their hands.