People take their cues about how to respond to something from the way you present it. If you treat polyamory as if it's an unfortunate medical condition or a guilty secret, that's how they'll see it. If you treat it as a bold philosophy that you're proud to share with the world, they may be impressed by your avant-garde amazingness.