I'm always a little depressed reading how defensive posts in these kind of topics read. It seems that people, instead of responding with something as noncommittal as "I'm not sure I see it as a problem, but I'll think about it and maybe see if it appears in my life so I don't perpetuate it", prefer to respond with "You think you've got it bad? There's no problem here!"
I think it's important to rationally separate yourself as a white man from the "white man", and just realize that all you can do as an individual is try to show respect to other individuals. If someone points out something that occurred in the past that made them feel uncomfortable, it isn't your job to go back there and set it straight. You don't need to somehow justify what happened by listing all the ways some subset of the population has been wronged in past or present. No one will feel better when you've dug up the most extreme extrapolation of views from the "other side" and posted them to support your case. All you can do is take what happened and try to apply it to your own life, and realize not everyone is coming from the same place as you.