"Don't make me answer that. I shouldn't have to answer that. It should be obvious." I'm unsure whether he's insinuating those three little words are how he feels, or if he's simply saying he shouldn't have to tell me he cares about me. Either way, I don't need his words of affirmation. I don't give him anything. He did us both a favor by not saying things he didn't feel in his heart.
