Later the Roosevelts moved into even larger quarters at 4 Elk Street, known as “Quality Row” for the affluent Albany families that lived along it. That mansion had been built by Martin Van Buren when he was governor—the first New York governor to reach the White House—and reflected Little Van’s penchant for lavish living.