One caution about A/B testing tools is that for all their ease of implementation, the data they provide is somewhat limited, because these tools rely on surface-level metrics, such as which button gets more clicks, rather than whether the people clicking the button ultimately become lasting users. Anyone who has clicked on an irresistible news headline only to be disappointed by the article can understand how a “click” is a poor indicator of long-term customer loyalty.
