Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

by Ron Kohavi

Statistical power is the probability of detecting a meaningful difference between the variants when there really is one (statistically, reject the null when there is a difference).