It is also the case that testosterone levels are higher in men during adolescence and young adulthood and, consequently, the sex drive peaks at those ages. For women, the sex drive doesn’t peak until the thirties, making for interesting challenges and opportunities as long-term relationships mature. Men and women often find that their sex drives align more closely as they enter their forties and fifties.