“A place that conveniently became both a solution to white Marylanders’ concerns and a pen for the Black people who’d just built it.”