That's preposterous--many societies suffer greatly because of the present relations of power. Look at Sudan or Yemen for tragically extreme examples.
Your premise is so badly wrong that the rest of the logic doesn't apply. This simply isn't what is meant by "harmful to society" because the power-holders in the society under scrutiny are not the ones who get to decide what counts. Rather, societies are judged relative to the ideally-impartial standards of the well-being of individuals and their ability to interact with each other to mutual benefit. You could argue with the standard if you wished, but what you're doing isn't even in the ballpark.