There is nothing wrong with making the occasional reader occasionally reach for the dictionary. However, the only legitimate reason to do that is if the word you have chosen is the best word to express the idea. Generally, saying “edifice” instead of “building” doesn’t tell your reader anything more about the building; it tells the reader that you know the word edifice.
