Individuals who have too many children are penalized, not because the whole population goes extinct, but simply because fewer of their children survive. Genes for having too many children are just not passed on to the next generation in large numbers, because few of the children bearing these genes reach adulthood.
