Depending on the details, it can render one infertile, and all-cause mortality is up at least in trans women (even if you exclude suicides: https://pubmed.ncbi.nlm.nih.gov/34481559/), so I wouldn't say the distinction is quite as stark as you make it. Indeed, the differences in all-cause mortality are not radically different from differences in all-cause mortality among paraplegics (see especially Figure 4 in https://www.nature.com/articles/sc201255 and contrast to the ~2-fold increase in all-cause mortality in trans women).
Caveat with trans all cause mortality: it's hard to find a representative control group.
Nonetheless, though I agree that exercise is extremely important, I think you're not doing justice to the complexity of the topic. For instance, one could go through all the neurological and stress-related risks of taking a path that is rejected by a significant portion of one's society: you're slowly killing yourself--just don't, someone might say.
There's a reason why that's the wrong thing to say.
But you don't seem to have grasped the general lesson here.