Of course--noticing the diversity and frequency of "oh, that didn't happen the usual way!" doesn't mean that people who are that way aren't people.

But it doesn't mean sex is constructed in the same way that gender is constructed. We have a lot of latitude--exactly how much is hard to say, but a lot more than we typically experience day-to-day in any particular culture--to decide what counts as acting like a woman, what counts as acting like a man, and what just is acting like a person. We have very little latitude to decide things about sex, far far less than we do with gender.

Indeed, it is largely because the societal expectations are malleable that we can treat everyone as people, and not have to worry overmuch about "male" and "female" not quite covering all cases crisply enough and us needing to also have a, "uh, yeah, not exactly--let me tell you about the biology of...".