If all else is equal, I agree: the easier one is to identify by those who would oppress them, the more oppression one will receive.
Not all is equal, though. And if you’ve read any individual accounts from the Holocaust, you know that “no one knows you’re Jewish” was far from true in practice.