And yet, the best time to invest is when the economy is doing terribly. That’s worth repeating. The best time to invest is when the economy is doing terribly. Don’t believe me? The returns from the S&P 500 are highest when the unemployment rate is above 9%.