"Well, then, why did you come and disturb me?" she said, almost angrily, if not quite, an enlarging red spot rising in each cheek. "I can't do what I think would be—would be—" "Right?" "No: wise."
He acknowldges that their marriage would not be wise. And yet... Yes, the narrator was correct in labeling love a weakness
