more than a specified number of customers (usually expressed as a percentage of the company’s total mainstream customer base). 5. Every experiment has to be evaluated on the basis of a single standard report of five to ten (no more) actionable metrics. 6. Every team that works inside the sandbox and every product that is built must use the same metrics to evaluate success. 7. Any team that creates an experiment must monitor the metrics and customer reactions (support calls, social media reaction, forum threads, etc.) while the experiment is in progress and abort it if something catastrophic
...more
