Site Reliability Engineering: How Google Runs Production Systems

by Betsy Beyer

Suppose an RPC has a 10-second deadline, as set by the client. The server is very overloaded, and as a result, it takes 11 seconds to move from a queue to a thread pool. At this point, the client has already given up on the request.