Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

by Ron Kohavi

A common mistake is to look at the confidence intervals separately for the Control and Treatment, and assume that if they overlap, the Treatment effect is not statistically different.