Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

Storing intermediate state in a distributed filesystem means those files are replicated across several nodes, which is often overkill for such temporary data.