Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

by Ron Kohavi

If it is unlikely, we reject the Null hypothesis and claim that the difference is statistically significant.