Statistics for People Who (Think They) Hate Statistics

by Neil J. Salkind

If the level of significance is .05, it means that on any one test of the null hypothesis, there is a 5% chance you will reject it (and conclude that there is a group difference) when the null is true and there really is no group difference at all.