Though this might be termed a “you and I” relationship, if it is one that can break down just because you raise an objection, then it is not the sort of relationship you need to get into in the first place. It is fine to just let go of it. Living in fear of one’s relationships falling apart is an unfree way to live, in which one is living for other people.