I found particularly amusing and readable are The Computing Universe [Papay and Hey, 2014] for a history of computers and The Computer and the Brain [Von Neumann, 1958] for a comparison between the two systems from the perspective of a pioneer from 60 years ago.