Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

If partitions are very large, rebalancing and recovery from node failures become expensive. But if partitions are too small, they incur too much overhead.