Pity is also an evil; a Stoic would allow it sometimes but only for the person with self-inflicted wounds, like the man who knows he destroyed the good man within him. Affection gets the widest tolerance of the three; if you can love as a man with a noble spirit, okay, but if the relationship requires you to be a slave and miserable, it does not profit you to be affectionate.
