To be clear I am very much against burka bans, anything similar that would limit them, or treating them differently.

I am just against it in principle because of the ideas behind it and against it being seen and represented as something ok. The two are different, I don't think the latter would get you called racist.

Also, a lot of opposition to the burka comes from a place of xenophobia. So much by groups that would otherwise be against many things that benefit women and whod have aneurysm at the mention of feminism.