The point is that even if there were no general reason to suppose that residents have an advantage over intruders, an ESS depending on the asymmetry itself would be likely to evolve. A simple analogy is to humans who settle a dispute quickly and without fuss by tossing a coin.
