With your permission, I'd like to go off on something that is both a bit of a tangent and absolutely central, I think, to understanding the consternation around the issue of being binary or not.
It has to do with either linguistics or philosophy, or perhaps both. I will introduce it with a question to you, vis a vis your claim that "there's no special place for anyone in either category because neither category has any boundaries."
For people who have been educated with a definitional mode of categorization, this seems like a problem. This is generally how we teach it, and so generally how we think we should understand it.
However, I have a question for you: are the categories of "chair" and "couch" bullshit?