They can make these impromptu analysis changes in all sorts of ways: dropping particular datapoints, re-calculating the numbers within specific subgroups (for instance, checking for the effect just in males, then females), trying different kinds of statistical tests, or keeping on collecting new data with no plan to stop until something reaches significance.