Distributed Systems Pattern: Request Pipeline

Communicating between servers within a cluster using Single Socket
Channel can cause performance issues if requests need to wait for
responses for previous requests to be returned. To achieve better
throughput and latency, the request queue on the server should be filled
enough to make sure server capacity is fully utilized.

more…