There's nothing wrong with being who you are. And there's nothing wrong with your partner for being poly. It isn't a moral failing. It isn't because poly people can't commit. That's important to keep in mind. Suggesting that polyamory is a problem or that there's something wrong with your partner is unlikely to make your relationship better.
