I hesitate to recommend what others should do, but I present a parallel for your consideration.
I am an atheist. Many deeply religious people maintain that atheists are necessarily wicked and selfish--fortunately I've been able to arrange my life such that these sentiments do not have a major impact on me, though were I less fortunate they certainly could, and I certainly don't appreciate the sentiments regardless. And yet, I love choral music, I love the beauty of cathedrals, I love Michelangelo's art, and so on.
Do I cut myself off from the creativity and beauty that the human race has created because some people in the group are unpleasant or bigoted or cruel--when I am the one gaining benefit from partaking, and they really don't have any increased ability to be unpleasant or bigoted or cruel because I do so?
Were I to act comprehensively, I would be forced to cut myself off not just on religious grounds, but many others (ethical, etc.), and would be forced to reject almost all of what is wonderful, amazing, enjoyable, and inspiring about being human. Because, alas, humans are flawed.
Alternatively, I could consistently enjoy the best parts of human nature while seeking to reject and work against the worst parts. I could marvel at the Pyramids while regretting that slave labor was used to construct them; I could admire the profound good the United States did by intervening to help win World War Two and subsequently via the Marshall Plan to rebuild our enemies stronger and better as allies instead of resorting to punitive measures, while deploring the profound evil the United States committed by repeatedly engaging in mistreatment of and genocide against native Americans.
I'm listening to William Byrd's Mass for Five Voices right now. It's lovely.