“Mr. Finch, I hate to fight you when you’re like this. You’ve been under a strain tonight no man should ever have to go through. Why you ain’t in the bed from it I don’t know, but I do know that for once you haven’t been able to put two and two together,
This must have to do something with his later attitudes in life. This night shook him up clearly like nothing else had, and understandably so, as any parent knows. And he must have felt in later years that his own actions had nearly gotten his children killed.
He didn't see Ewell coming for his children. That had to shake him. It would shake any caring parent far beyond one night.

