Designing Data-Intensive Applications: The Big Ideas Behind Reliable, Scalable, and Maintainable Systems

by Martin Kleppmann

From time to time, run a merging and compaction process in the background to combine segment files and to discard overwritten or deleted values.