Absolutely, but the demonization if any should be in proportion to the denial of rights.
And we have also to recognize the awkward reality that two groups can each want to trample on what the other considers as their rights. For instance, male religious fundamentalists--Islamic especially, lately, but they don't have a monopoly on this point of view--might think that their basic rights include the right to live life in public without the sinful temptation of exposed female bodies. Women who are not comfortable adherents of that religion might in contrast think that their basic rights include the right to wear what they feel is comfortable and appeals to them.
It's very easy for a polarized debate to devolve into ridiculous caricatures of the main viewpoint of the other side--and for some people on each side to fall into those ridiculous caricatures. But while a substantial non-caricatured population exists, it does everyone a disservice to have only the caricatured discussion, where no progress can be made, and never have the fair but perhaps difficult discussion about the actual responsibilities we have towards each other as humans, and how that translates into rights.
In particular, trans advocates tend to fall back on "they deny our right to exist" as a rhetorical strategy even when facing disagreement from people who explicitly affirm their right to exist.
That there are Nazis does not mean that anyone expressing concern about adequate parking for a new Jewish community center is a Nazi.