We believe online controlled experiments are: The best scientific way to establish causality with high probability. Able to detect small changes that are harder to detect with other techniques, such as changes over time (sensitivity). Able to detect unexpected changes. Often underappreciated, but many experiments uncover surprising impacts on other metrics, be it performance degradation, increased crashes/errors, or cannibalizing clicks from other features.
