This is the trouble with all kinds of p-hacking, whether explicit or otherwise: they cause the analysis to – using the technical term – overfit the data.73 In other words, the analysis might describe the patterns in that specific dataset well, but those patterns could just be noisy quirks and idiosyncrasies that won’t generalise to other data, or to the real world. This is useless.
