That argument would be torn apart pretty easily
Sure. The argument can be torn apart. But that doesn't change anything. What changes when you make those sorts of arguments is simply that it gives a green light to pushing back against marginalised people.
If argument being torn apart was enough, the argument against trans folk in sport wouldn't even be an argument. But it is, because there is a political interest in creating harmful narratives about trans folk, and using exclusion from sport as a wedge to normalise exclusion in other areas. Which is exactly what is happening.
So if you're ok with that sort of question, I think you need to spend a bit more time looking at the context those questions exist in. Why is it now that people want to suddenly talk about trans people in sports. It's not because the trans folk have been doing anything different. It's because there is an explicit motivation to create a culture war, with trans folk as the targets. You shouldn't be ok with being part of that.
This is all an interesting hypothetical to you. To me, it's my lived life. Trust me, I've done what you're talking about. I was active in /r/changemyview, and I've spent a lot of time having this discussion with people on social media.
And in that time, not a single person has changed their perspective or view on the topic. Because they already had a view, and despite the ostensible goal of the sub, they're largely not open to changing their view. They may want to, but they're not actually willing to change it. Because ultimately, people arrived at their "concerns" through emotional manipulation, and that can't be undone by "rational discussion". Like sure, maybe you're the single exception, and in my 5+ years of having this discussion, you might be the first to genuinely change your opinion. But even then, after 5 years of normalising the idea that my rights are up for discussion, as if it's actually ok for people to want them removed because of their "concerns", I'd have a single changed mind in 5 years.
But you know what else I've done in those 5 years? I've told every other person that I've had this discussion with that it's actually ok to debate my rights, that whether or not I deserve rights is based on how well I can debate and argue. And I've given the bigots driving this whole discussion exactly what they wanted, which is to make myself a target.
Fuck that.
So what does it say about me? It says I've got more lived experience in navigating this topic than you ever will, and I'm no longer willing to see "civil discussion" on the erasure of peoples rights, in the pointless hope that it will actually help us. Because it doesn't.