He wanted Adaira to ask him to join her in the west. To invite him to be with her again. Because he could not bear to beg her to take him, and he feared being in a place where he was unwanted. He refused to put himself in such a position, and so he had no choice but to appear utterly resilient as he waited for her to decide what was to become of them.
