One of the default assumptions that many of us carry from monogamous culture is that in a long-term relationship, especially when we live with a partner, our partner's time becomes "ours" by default. So when he chooses to do something social that's independent of us, it's outside the norm—and thus can feel like he's taking away something that rightfully belongs to us.
