At the same time, the authors pointed out that the biggest effect is seen at the bottom end of the scale. Those with the very lowest intelligence scores tend to be male. This is partly genetic. X-linked mental retardation, for instance, affects far more men than women.