In rarer situations, if you feel sufficiently threatened, or emboldened by a crowd, you might decide to challenge the leader, to fight them. Pitchforks, torches, crosses (or canceling) ensue. The only thing to do in this case is eradicate the one who makes you feel this uncomfortable.