'White' is short hand for 'had a better past'.
Racism by definition is to classify or negatively assign traits from the collective regardless of if it applies to the individual.
When you talk about any privilege, you're saying 'because of your race, class you are where you are' that's not correct, because of your past you are in part where you are. And statistically men, and white have occupied what the western world would call 'success'.
The problem with this game everyone seems to be playing looking and gender and skin is it's a game no one can win...
Women need more rights to make up for man's dominance... ok, but if that's the game, then black people need more rights against the white woman...
Then trans people need more rights against black women
Then a disabled trans black woman needs more rights
And we haven't even touched on income, home life, personal history... you just can't do this and win, it's a 'race' to see who has it worse...
What if you're a white man (image in your head) but is an eastern European person coming from communist torturer crimes where his whole family was killed verses say Serena Williams?
If the argument, it's the collective and collateral damage to individuals is the price of over equality... That is actually exactly what communism is built on!
So what do we do then? Let white men rule and everyone suffer? God no, treat everyone the individuals they are, and if it's in your nature to try the equality path, go for it, but don't attach it to gender or skin colour for goodness sake, there are so many more measurable things which matter so much... we can start with our childhood where we were all once at the mercy of people much more powerful and made choices we had no say over.
Read this... it's a start to a fairer, equal and happy society by empathising with each other's burdens.
https://www.psychologytoday.com/us/blog/driven-distraction/201802/how-people-beat-the-odds-after-rough-childhood?