“The act of self-denial seems to confer on us the right to be harsh and merciless toward others.”