Fascist voters are mostly white men and they have been a privileged group since white men were invented. Even working class white men were of higher ranks compared to women or immigrants up until mid 1900s.
This order is profoundly shook-up when women, gays , immigrants and minorities took their place, so even working class white men are now pissed off because life isn't what they were promised by their patriarchs.