Sure, sounds good to me!

However, if you're going to reserve "black" as a subcategory of "people of color", others will reserve "white" as a subcategory of "people of pallor".

I think this might be contrary to some of your goals. Not sure it's really helpful to have, say, Brits be "white" and Italians not (again), or however that turns out.