Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

Dataflow engines perform less materialization of intermediate state and keep more in memory, which means that they need to recompute more data if a node fails.