This isn't a valid argument as it stands. It's exactly the same form as, "I didn't bother addressing whether murderers should have access to guns, because murderers don't need guns to kill people." If you can see the problem with that logic, you will also find the error in how you have argued above. (However, Hannah gives a valid, though very brief, argument in her comment.)
(I understand your other points--and I agree that the regressive right will happily use arguments put forth by terfs to regress further if they can.)
Anyway, it was a strange choice to explicitly call out something as an item to address if you didn't intend to bother to address it. But now you have, so at least anyone reading all the comments won't be wondering, "But what *is* the solution to men pretending they are trans women?"