Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

Thus, when using a dataflow engine, materialized datasets on HDFS are still usually the inputs and the final outputs of a job.