I shouldn’t have let you go, I will never let you go, don’t let me go, etc. The expression is often used as a form of regret: I’m angry at myself for having let you go, I should have made you stay. We think it’s our fault if the other person leaves us, that we could have done something to stop it. We imagine that we could have acted in such a way as to preserve their desire to be together.
