Truly free markets trade efficiency for market-tested innovation that is heavily reliant on luck. The reason this inefficient process is necessary is because most of the achievements of consumer capitalism were never planned and are explicable only in retrospect, if at all.
