Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

by Ron Kohavi

as a system grows to have hundreds to thousands of parameters, even if an experiment likely affects only a few parameters, then optimizing parameter handling, perhaps with caches, becomes critical from a performance perspective.