As they get older and older, you will find more and more time for yourself, more and more downtime. But in these first six years, you have to be fairly brutal about carving out time for yourself, your relationship with your spouse/partner, and the family as a whole.
