Site Reliability Engineering: How Google Runs Production Systems

by Betsy Beyer

If the request rate and latency of a given task is constant, there is no reason to queue requests: a constant number of threads should be occupied.