“What explained this shocking increase in support? This was not because whites affirmatively favored discriminating against minorities”