People liked to argue otherwise, but deep down, they understood that it was a challenge to level the economic playing field between white and black Americans when one group of people had inherited their wealth over generations by using the other group as forced or low-paid labor. So even a family like his would continue to be regarded with doubt.