This would not be about mixing men and women, but about mixing at-least-somewhat-transitioned trans women on androgen suppression therapy.
At that point, it's a much more complicated question (especially if some biological women are allowed to have higher natural testosterone levels than the trans women are allowed to maintain their testosterone levels).
I don't think you can pre-judge the answer. We need to do research, and then pay attention to what it tells us.