Brian

21%
Flag icon
Suppose a system without caching required 20 replicas, but with caching required only 15. If each replica is a machine, this means the cache is more cost-effective if it costs less than purchasing 5 machines.
Brian
This might be dangerous advice. It sounds like using cache as a scaling/availability strategy, which can be risky. Loss of cache means outage? Caching should be a performance tool, not availability tool.
Chet
· Flag
Chet
I agree that caching should focus on reducing P50 performance.

What about p99/p100? We have situations where caching is the only thing keeping an API/page working. Otherwise, it's unavailable for a par…
Brian
· Flag
Brian
That's a special case and you shouldn't consider it caching in that case. It becomes a nonauthoritative, nonephemeral data store. But you'll still probably need a way for the cx to gracefully degrade …
Practice of Cloud System Administration, The: DevOps and SRE Practices for Web Services, Volume 2
Rate this book
Clear rating
Open Preview