It was very much a southern town, with ten thousand white citizens, seven hundred free blacks, and three thousand slaves. As a result, the majority of the six hundred workers who erected the White House and the Capitol were slaves whose wages were garnisheed by their masters.