The people who are afraid of the Gossip Trap (or Cancel Culture, Woke Mobs, the Media, or whatever you want to call the kind of social pressure that can create change) are the ones who have reason to be: they have outsized power in our society, and they want to hold on to it.
