The houses leading up to theirs are all just as grand, but none seems as thoughtful. The multiple libraries, museum-quality art—and the family’s deep knowledge of it—must make their home the most cerebral one in the neighborhood. They’ve woven intellectual luxuries into physical ones.

