In 1862, Mrs. Astor and her husband built a brownstone town house at 350 Fifth Avenue, hastening the movement of fashionable New Yorkers northward from their former strongholds around Washington Square. From there, and from her summer cottage in Newport, Mrs. Astor watched as New York City grew and changed at a whiplash-inducing pace in the years after the Civil War.