Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

Partitioning is necessary when you have so much data that storing and processing it on a single machine is no longer feasible.