If you need a break, take it. Since you’re the one taking a break from the conversation, it’s your responsibility to seek your partner out to finish the discussion later. It’s not your partner’s responsibility to come back to you to discuss the topic when you were the one who took a break.