Smith was not criticizing the wealthy per se. But he was criticizing those who wasted their wealth on lavish consumption–‘collecting books, statues, pictures’, or ‘more frivolous, jewels, baubles, ingenious trinkets’–instead of productive investment.
