It's probably because they don't want some fingers pointed back at them, don't want their egos bruised by people pointing out their role in sustaining institutionalized prejudices.

Even on the Left, white men are the most thinned-skinned fragile mothereffers around, their egos unable to bear the slightest criticism.