Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

Microbatching and checkpointing One solution is to break the stream into small blocks, and treat each block like a miniature batch process.