The problem is that, along with your self-reliant attitude, you also train yourself not to care about how the person closest to you is feeling. You figure that this is not your task; that they need to take care of their own emotional well-being. This lack of understanding leads partners of avoidants to complain about not receiving enough emotional support. It also leads to less connectedness, warmth, and satisfaction in the relationship.
