Grant’s in-laws were Missourians who owned slaves before the War; Grant acquired one from them and set him free a year later. As for Lee, the slaves in question were those his wife inherited in October 1857, with the stipulation that Lee, as executor, emancipate them within five years. Lee missed the deadline and didn’t free the slaves until December 29, 1863.
