So what's my clever solution? Sorry, I haven't got one.
I sometimes try to remind myself that in some situations I'm the minority, and sometimes I'm the majority. Yes, I'm Black - and I'm angry with ignorant white people. But I'm also a man - and I probably ask lots of ignorant questions ("Have you considered not wearing that short skirt?") and then I wonder why women get mad at me.