Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing

by Ron Kohavi

While education can help, options in the tool to use p-value thresholds smaller than the standard 0.05 value are effective. Lower thresholds allow experimenters to quickly filter to the most significant metrics (Xu et al. 2015).